What kind of content are you likely to include on your personal website? I think that would be more likely to dictate your decision.
One thing with your example of 'infinite scroll' is that it works better for linear paths, where things are in a set order and you want to force the user on a step-by-step path forwards or backwards. A regular website, allows the user more freedom to different parts of the page and content - while it is also linear, it is easier for the user to move between points in the path.
So if you're happy with your content following very defined steps, and you can design it so that scroll, drag and keyboard navigation is possible, then give it a try.
In terms of use on a personal website, this could certainly work, but be aware of designing for other limitations that could occur - for example, how would this look on a touch device, where the user is swiping/scrolling with their finger?
I would say that the suitability of your two options very much depends on content and design, and that under different circumstances each could be a better option. More often than not, from the personal websites that I've seen, I would say that 'Scroll-able' is better suited for the content on those websites, and that is the design that most have used.