I need to know if i should walk away or stay with a certain someone?

well i been talking to someone for like a year now and we have gotten closer within the last like 4-5 months.. well this person is really shy, and im am as well. But not as bad as him, well this person is the type of person that puts thick walls up .. and its really hard for us to communicate, and when he does its a little here and there ... well we hung out little and we got close and he knows exactly how i feel about him and i ask him and hes just to scared to open up to but he say things in response that are indirect but let you know that he cares, but not enough to make you really understand the meaning ... and it makes me think that he doesn't really care ... and i just don't what to do. i want to stick around, but i don't want to be there if this person don't care, then i sit and think does he care or don't he care... when we are alone or talking we are really close, but sometimes he will push me away and make me think like what the heck.. are you in or are you out. its bothers me because i don't wanna stick around if hes just pulling me along or is it because he is so shy and don't know how to express his self .. because i always second guess that one minute he likes me and the next minute, he wants me to leave me alone ... and keep in mind i am not a person that sits around and pushes anybody, or over obsesses and is really attached to push him in the direction of saying get away from me either.. he is really nice polite person and does things in that manner and there is things he does and says and shows care that any call or friend would go that far to do for or express care ...awww someone help me