I suspect that you need to adjust the shift cables. After replacing a cable end I had nearly the same issue but with 1st gear until I finally dialed in the adjustment. Don't ask me if I had to lengthen or shorten the cable, but it sounds like you need to do the opposite.