How do I make Baby Bearded Dragon feel calm around me?

Bought it 4 days ago at 5 weeks old. He is scared of me and my family and it hides slot. I hand feed him once in a while and pet him all the time. And pick him up 2-3 times a day and he is still scared. How can I make it feel safe around me?