I think if you go into it knowing it will be a LOT of work initially, you could be fine.
In my area if I get little ones, it's pretty much guaranteed income for five years. It's hard to turn that away!
ETA: I would also try not to think of them as babies, but as toddlers (which they'll be) I'm guilty of doing this and then "babying" them :O which makes life harder
