a stumbling block

a problem which prevents someone from achieving something (often + to ) Lack of willingness to compromise is the main stumbling block to reaching a settlement. Money, obviously, is a major stumbling block in any project of this size.