I'm fairly certain the "i" began with the first iMac (remember all the different colors that were available?), which I believe was short for "internet". Plug it in, connect an ethernet cable to your cable or DSL modem or a phone line for a dial-up connection, turn it on and you had internet access.
The "i" was followed by being included with the iPod name and iTunes, and the rest followed.