Deep learning models are typically built using artificial neural networks, which consist of an input layer, one or more hidden layers, and an output layer. Each layer contains nodes, and connections between nodes have associated weights that are learned during the training process.