The incident happened Monday evening near Olive Way and Melrose Ave.
Witnesses say they first heard arguing. Then the situation escalated with the suspect following the family and unloading the pepper spray canister.
Baby was unharmed.
Cops eventually arrested the man for assault.