Three years after China opened its $355 billion hedge fund market to global asset managers, the industry is discovering just how hard it is to win over the country’s investors.