This will depend on the hospital. Hospitals usually allow you to stay with your child all day and even stay the night in the same room. You will need to ask if this is the case for the hospital of your choice.
Find in this list the services offered to parents by Brussels hospitals: http://www.hospichild.be/fr/pendant/services/services-aux-parents