upgrade from snow leopard server to lion client

I have a mac mini server, but I don't use the server stuff and would rather just get ride of it. Is it possible to go from snow leopard server to lion (just the client version). I've bought lion for my other computers, but when I try to upgrade my mac mini, I get a message that I need to also buy Lion server.

Thanks for the help.