A taxonomy is a way to group things together. It might contain only one attribute of interest to users. You can define hierarchical (terms with a parent term) or nonhierarchical (terms without a parent term) taxonomies.
Connections allow entities to get and send data from/to external apps or services such as incoming/outgoing email, twitter, facebook etc. Incoming email is a connection type you can use to import email messages to your entities.