Yes you will still need to register your LLC with the New J State Dept. The state of New Jersey treats a single member LLC the same way as the federal, in that the income from the LLC can be reported on your state tax return as a sole proprietorship. You would be filing a Schedule C for federal purposes and that carries over to the NJ-1040 state form. You also need to file the New Jersey Annual Report each year.