People tend to forget a lot of muscles when they work the abs. The obliques are pretty important when trying to get some definition in your abs.
The up-down movement of the sit-up shouldn't be your only abs strength training. Twist from your midsection and look to the left and the right as you turn. See the video below for a demonstration.
Cheers Eights & Weights!