Yes, the Arduino plugs into the USB port and looks like a USB serial device. You can read/write the serial port on the Arduino side, and write code on the host side to talk to the serial port.
Another option, if your host is Android, is to use the "ioio" boards for Android, which are roughly "arduino for android with pre-built libraries" and may make things slightly easier.