Labs V2 is a Lucid IDE with limited Verilog support.
If you’re planning to go the full Verilog route, you should likely just use Vivado directly and the Alchitry Loader (or reflash the FTDI to work directly in Vivado).
Note that if you want to start from any of the templates, you can make a project in Alchitry Labs, build it, and the build folder is a Vivado project. You can copy this somewhere else and use it as a starting point.