I think it's fine. These are some examples of some sideboards that match the table and those who don't:
http://www.houzz.com/ideabooks/17542991/list/buffet-sideboard-server-credenza-whats-the-difference

I can't say whether or not you would regret it, but I think it depends on the size of your room. A console table would look more modern and take up less visual space, if that's a concern. We just removed our sideboard and don't miss it at all.

I cannot find a sideboard that I care for that would go with my dining set. I don't exactly have the need for the extra cabinet space at this point in my life. The serving dishes I have and China set I have can fit in my kitchen cabinets (and worst case scenario...basement closets), but it is important to me to have some tabletop serving space. Is it weird to do a console style serving table in place of a sideboard? Will I regret not having the extra cabinet space down the road? Help me think this through! Thanks.