You can do it, but it's not ideal. I rode for years in Raichle Flexon Comp ski boots, and they were great for the time and the application (racing), but in general, ski boots suck for freecarving.
If you can find flexons or something similar for cheap, try them out. I think you could find used boots and bindings here in the classifieds for a couple hundred bucks. use the boards you have already to start. That Prior sounds like a fun board.