Homebuyers and housing experts have tried to remain optimistic about the direction of the U.S. housing market, but the lack of significant improvement in affordability has left people feeling weary.