Yes. If you have a Norwegian child who is going (moving) to Norway with you, you are required to obtain a Norwegian passport for the child. You apply for a Norwegian passport at the nearest Norwegian embassy or consulate. Contact the embassy or consulate to obtain a Norwegian passport for your child. (external website)
You can read more about how to register your child here (external website).