The protocol that assigns IP addresses automatically (and makes sure they're unique) is called DHCP. Enable the DHCP server on your base station, and set all the clients to get an address from it.
That is too vague an answer to be practical.
For one, the likelihood is that the DHCP server is already enabled in the AirPort Extreme - or, at least there's already a DHCP server running on the network. If it's already running then 'enabling it' is not going to help. If it's not already running then you just enabled a second DHCP server in the network which is going to cause even more problems.
Besides, you cannot easily "set all the clients to get an address from it". DHCP uses a broadcast protocol to find DHCP servers and, generally, whichever server responds first is the one the client will use. There's no client-side way to tell any given device which DHCP server to use.
Besides, as described, it's not even clear that the IP address is even in use by another DHCP-based client. It could be some other device on the network (printer, maybe?, Blu-Ray player? PS3? X-Box? or even some rogue client) that's configured with a static address.
The actual solution to this problem requires some troubleshooting. You'll need to start off with the base station - it will give you a log of the connected clients listed by MAC address and assigned IP address. Cross reference this list with the known devices (Mac, iPad, and iPhone) and you may find the rogue device. Once you have the MAC address you can start to trace the device on your network.