Challenges of standard halo models in constraining galaxy properties from CIB anisotropies