Just called JPN Hotline and the latest answer to this question is:
Yes, you can register at any JPN office.

Can get the birth cert immediately, but will take a while to get the MyKid depending on the branch.

That said, the person on the hotline told me the JPN branch near my place would need 45 days to prepare the MyKid card, but I got everything settled within 2 hours.