for the non-resident of New york state, do i enter only the w-2 for the income that was earned in New york state which was from oct to dec of last year

Yes, you will enter the income from the New York-based company as New York income for 2024.  It is considered New York source income because New York has a "Convenience of the employer" rule.  

Did your husband physically work within New York State, or did he perform his work remotely from MA?  If he never physically worked within NY, then his income is not taxable by NY.

If he physically worked within NY, then the TT program will ask you to enter his total federal income, and then to apportion according to his time worked in NY in order to determine to determine his NY tax due.