An Introduction to List Comprehensions in Python
Let’s start with a simple list.
>>> my_list = [1, 2, 3, 4, 5, 6, 7, 8, 9, 10] >>> my_list [1, 2, 3, 4, 5, 6, 7, 8, 9, 10]
Quite often, we’ll need to build a new list from the elements of an existing list. For example, let’s say we want to make a list containing all elements of
my_list, each multiplied by 2. A common way to do this is by iterating through the existing list and building the new list:
>>> new_list =  >>> for x in my_list: ... new_list.append(x * 2) ... >>> new_list [2, 4, 6, 8, 10, 12, 14, 16, 18, 20]
Now let’s take a look at how to do this using Python’s list comprehension syntax.
>>> new_list = [x * 2 for x in my_list] >>> new_list [2, 4, 6, 8, 10, 12, 14, 16, 18, 20]
The syntax for list comprehension is based on set builder notation. Given the form
[Y for X in LIST],
Y is commonly referred to as the output function ,
X is the variable, and
LIST is the input set. This statement says to do
Y on each
For an example of using a different output function , let’s say say we want a new list that contains each number in
my_list as a string type…
>>> [str(x) for x in my_list] ['1', '2', '3', '4', '5', '6', '7', '8', '9', '10']
You may be asking yourself why we wouldn’t just use
>>> map(str, my_list) ['1', '2', '3', '4', '5', '6', '7', '8', '9', '10']
In this example,
map looks like a good alternative. However, for slightly more complicated requirements, list comprehension can be a bit more concise. For example, when we’d like to specify a predicate .
Consider our previous example, where we want to create a list of string types for each element in
my_list, except this time we only want the elements which are even numbers. A typical way to do this would be:
>>> new_list =  >>> for x in my_list: ... if (x % 2) == 0: ... new_list.append(str(x)) ... >>> new_list ['2', '4', '6', '8', '10']
In order to use
map() here we would need to first
filter the list to exclude the odd numbers.
Using the list comprehension syntax would look like this:
>>> new_list = [str(x) for x in my_list if (x % 2) == 0] >>> new_list ['2', '4', '6', '8', '10']
This version introduces the predicate, an expression after the list which acts as a filter on which elements get passed to the output function.
Neat, clear and concise.
Loops of loops.
Finally, it’s worth mentioning that you can use list comprehensions to iterate on more than one list. For example:
>>> list_a = ['A', 'B'] >>> list_b = [1, 2] >>> [(x, y) for x in list_a for y in list_b] [('A', 1), ('A', 2), ('B', 1), ('B', 2)]
Just like you would expect in
for loops, the last loop moves the fastest. Also note that this method returns a list of
tuples. If you’d like nested lists, you can also nest one list comprehension within another.
>>> list_a = ['A', 'B'] >>> list_b = ['C', 'D'] >>> [[x+y for x in list_a] for y in list_b] [['AC', 'BC'], ['AD', 'BD']]
List comprehension in Python can often provide a neat, clear, and concise syntax for creating lists from other lists. However, one should always be aware that, particularly for complex transformations or predicates, the concise and terse syntax can quickly become very difficult to read. In these cases, it’s often beneficial to revert to traditional looping constructs.
- Set Builder Notation
- PEP 202 — List Comprehensions
- Python Patterns – An Optimization Anecdote
- Python Performance Tips / Loops
by Carl Groner
Last Changed: December 01, 2011 blog comments powered by Disqus