When sould i take my baby to the hospital with fever?

My baby woke up crying today with runny nose 101.5 fever and coughing, I took him to his pediatric she said he has an ear infection, she gave me medicine for the infection and told me to give him motrin for his fever, but his fever won't go down, it was at 103, Should i take him to the hospital? he is 11 months.