582

In C# there's a null-coalescing operator (written as ??) that allows for easy (short) null checking during assignment:

string s = null;
var other = s ?? "some default value";

Is there a python equivalent?

I know that I can do:

s = None
other = s if s else "some default value"

But is there an even shorter way (where I don't need to repeat s)?

3
  • 44
    The ?? operator is proposed as PEP 505. Commented Oct 20, 2016 at 18:39
  • 54
    ..but never made it into the language. Commented Dec 11, 2020 at 7:37
  • 8
    One of the biggest strengths of Python is its expressiveness. It's a pity Python doesn't provide a None-coalescing operator. The ternary alternative is way more verbose and the or solution is simply not the same (as it handles all "falsy" values, not just None - that's not always what you'd want and can be more error-prone). Commented Jul 21, 2021 at 10:08

16 Answers 16

745
other = s or "some default value"

Ok, it must be clarified how the or operator works. It is a boolean operator, so it works in a boolean context. If the values are not boolean, they are converted to boolean for the purposes of the operator.

Note that the or operator does not return only True or False. Instead, it returns the first operand if the first operand evaluates to true, and it returns the second operand if the first operand evaluates to false.

In this case, the expression x or y returns x if it is True or evaluates to true when converted to boolean. Otherwise, it returns y. For most cases, this will serve for the very same purpose of C♯'s null-coalescing operator, but keep in mind:

42    or "something"    # returns 42
0     or "something"    # returns "something"
None  or "something"    # returns "something"
False or "something"    # returns "something"
""    or "something"    # returns "something"

If you use your variable s to hold something that is either a reference to the instance of a class or None (as long as your class does not define members __bool__() and __len__()), it is secure to use the same semantics as the null-coalescing operator. NB. Python 2.7 will look for __nonzero__() instead of __bool__().

In fact, it may even be useful to have this side-effect of Python. Since you know what values evaluates to false, you can use this to trigger the default value without using None specifically (an error object, for example).

In some languages this behavior is referred to as the Elvis operator.

Sign up to request clarification or add additional context in comments.

30 Comments

The number 0, None, and empty containers (including strings) are considered false, in addition to the constant False. Most everything else is considered true. I would say that the main danger here would be that you would get a true but non-string value, but that won't be an issue in some programs.
Using this other will get the default value if s is None or False, which may not be what is wanted.
There are many obscure bugs caused by this as well. For example prior to Python 3.5, datetime.time(0) was also falsy!
This is bad. I recommend adding a notice about its pitfalls. And recommending not to use it.
⚠️ This is an antipattern. Use other = "some default value" if s is None else s. See also: stackoverflow.com/questions/13710631/…
|
190

Strictly,

other = s if s is not None else "default value"

Otherwise, s = False will become "default value", which may not be what was intended.

If you want to make this shorter, try:

def notNone(s,d):
    if s is None:
        return d
    else:
        return s

other = notNone(s, "default value")

Note, though, that since that's a function, it won't short-circuit like the conditional operator would if the first value isn't None; instead, it will evaluate both arguments even through the second one doesn't end up being used. For example, if a is not None, notNone(a, get_some_value()) will still call get_some_value, but a if a is not None else get_some_value() won't (operators can short-circuit, and the conditional operator does).

3 Comments

This should be the answer
I wonder what to do if my case is other = s.name if s is not None else "default value", is there also a shorter way like notNone?
This should be the answer and Python could consider adding such a convenience operator
71

Here's a function that will return the first argument that isn't None:

def coalesce(*arg):
  return reduce(lambda x, y: x if x is not None else y, arg)

# Prints "banana"
print coalesce(None, "banana", "phone", None)

reduce() might needlessly iterate over all the arguments even if the first argument is not None, so you can also use this version:

def coalesce(*arg):
  for el in arg:
    if el is not None:
      return el
  return None

5 Comments

def coalesce(*arg): return next((a for a in arg if a is not None), None) does the same as your last example in one line.
I get that people want to explain if else sytnax etc, but coalesce takes an arbitrary argument list so this should really be the top answer.
glglgl has the best answer. I used timeit on a large test array and the reduce implementation is unacceptably slow, the multi-line for/if version is fastest, and the next implementation is very slightly behind. The next version is the best overall when considering simplicity and conciseness.
@glglgl has interesting snippet. Unfortunately because Python does not have pass-by-name, coalesce like this is not short-circuiting; all of the arguments are evaluated before the code runs.
This works for me, but as of Python 3 (Python 2 is now EOL), from functools import reduce is required. Also, print is now a function that returns None, and not a statement.
48

In case you need to chain more than one null-conditional operation such as:

model?.data()?.first()

This is not a problem easily solved with or. It also cannot be solved with .get() which requires a dictionary type or similar (and cannot be nested anyway) or getattr() which will throw an exception when NoneType doesn't have the attribute.

The relevant PEP considering adding null-aware operators to the language is PEP 505 and the discussion relevant to the document is in the python-ideas thread.

5 Comments

There's no null-coalescing operator in model?.data()?.first(). This answer isn't relevant to the question.
@Travis did you read past that line?
^ it threw me off at first too - though if I'm being pedantic, that's not null coalescing in other languages either. It's C#'s null-conditional operator or typescripts optional chaining
@Chazt3n okay, fixed
it's good it's here because I had no idea what that operator was called
18

I realize this is answered, but there is another option when you're dealing with dict-like objects.

If you have an object that might be:

{
   name: {
      first: "John",
      last: "Doe"
   }
}

You can use:

obj.get(property_name, value_if_null)

Like:

obj.get("name", {}).get("first", "Name is missing") 

By adding {} as the default value, if "name" is missing, an empty object is returned and passed through to the next get. This is similar to null-safe-navigation in C#, which would be like obj?.name?.first.

3 Comments

Not all objects have .get, this only works for dict-like objects
I'm submitting an answer edit to cover getattr() also.
get on dict does not use the default parameter if the value is None but uses the default parameter if the value does not exist because the key is not in the dict. {'a': None}.get('a', 'I do not want None') will still give you None as a result.
13

Addionally to @Bothwells answer (which I prefer) for single values, in order to null-checking assingment of function return values, you can use new walrus-operator (since python3.8):

def test():
    return

a = 2 if (x:= test()) is None else x

Thus, test function does not need to be evaluated two times (as in a = 2 if test() is None else test())

1 Comment

This is the cleanest way of achieving null-coalescing in my opinion. I use it for functions that can return the object or None, and want to access it on the same line; ie: email = user.email if (user := get_user_fn()) else None
4

For anyone still in need of a null coalescing for functions in 2024:

def null_coalesce(*args):
    return getattr(args[0], args[1], None) if len(args) == 2 else null_coalesce(getattr(args[0], args[1], None), *args[2:])

worked for me. This variant works if you want to access a field that may or may not exist. E.g. for foo.bar._name_ you would execute null_coalesce(foo, 'bar', '__name__') and would either receive the name of the function or if this field does not exist, you would get None and NOT an AttributeError.

Comments

2

In addition to Juliano's answer about behavior of "or": it's "fast"

>>> 1 or 5/0
1

So sometimes it's might be a useful shortcut for things like

object = getCachedVersion() or getFromDB()

1 Comment

The term you're looking for is "short-circuits."
1

to take care of possible exceptions:

def default_val(expr, default=None):
    try:
        tmp = expr()
    except Exception:
        tmp = default
    return tmp

use it like that:

default_val(lambda: some['complex'].expression('with', 'possible')['exceptions'], '')

Comments

1

I had a similar issue, but none of the solution above were quite satisfactory for me. I did some tests, then a nice idea came to my mind ... and it works !

it is at the same time elegant and 'descriptive' enough according to Python standards I think. I'll let you the judge of it.

First the issue:

I have a class Completion which has either a reference to sequence_type1 or sequence_type2

I want to define a property such as this:

@property
def seq_pk(self):
    return self.sequence_type1.seq_pk if self.sequence_type1 else self.sequence_type2.seq_pk
    

That's not really nice looking, takes a lot of space ... and I will need to do the same for all the properties of Completion !

I cannot simply do

return self.sequence_type1.seq_pk or self.sequence_type2.seq_pk

because if self.sequence_type1 does not exist, an exception will be raised, instead of giving me self.sequence_type2.seq_pk

But what I discovered works nicely is the following:

return (self.sequence_type1 or self.sequence_type2).seq_pk

simple, descriptive, elegant I think

Comments

1

Rather than explain what the or operator does, and how it is not a useful null-coalescing operator, I propose a pragmatic coalesce function.

def coalesce(*args):
    '''
    Returns the first non-None argument,
    or None if all arguments are None.
    If an argument is a function,
    it is called and its result is used instead.
    '''
    for arg in args:
        if callable(arg):
            arg = arg()
        if arg is not None:
            return arg

Verify it works:

print(f'Should be None: { coalesce(None) }')
print(f'Should be 0: { coalesce(0) }')
print(f'Should be 1: { coalesce(None, 1) }')
print(f'Should be 0: { coalesce(0, 1) }')
print(f'Should be 1: { coalesce(None, lambda: None, 1) }')
print(f'Should be 1: { coalesce(None, lambda: 1) }')
print(f'Should be "": "{ coalesce("", 1) }"')
print(f'Should be False: { coalesce(False, 1) }')

To improve performance one would supply a lambda function instead of a constant when the value is expensive to compute, and that way the expense can be avoided if an earlier argument is not None at runtime.

Comments

0

Regarding answers by @Hugh Bothwell, @mortehu and @glglgl.

Setup Dataset for testing

import random

dataset = [random.randint(0,15) if random.random() > .6 else None for i in range(1000)]

Define implementations

def not_none(x, y=None):
    if x is None:
        return y
    return x

def coalesce1(*arg):
  return reduce(lambda x, y: x if x is not None else y, arg)

def coalesce2(*args):
    return next((i for i in args if i is not None), None)

Make test function

def test_func(dataset, func):
    default = 1
    for i in dataset:
        func(i, default)

Results on mac i7 @2.7Ghz using python 2.7

>>> %timeit test_func(dataset, not_none)
1000 loops, best of 3: 224 µs per loop

>>> %timeit test_func(dataset, coalesce1)
1000 loops, best of 3: 471 µs per loop

>>> %timeit test_func(dataset, coalesce2)
1000 loops, best of 3: 782 µs per loop

Clearly the not_none function answers the OP's question correctly and handles the "falsy" problem. It is also the fastest and easiest to read. If applying the logic in many places, it is clearly the best way to go.

If you have a problem where you want to find the 1st non-null value in a iterable, then @mortehu's response is the way to go. But it is a solution to a different problem than OP, although it can partially handle that case. It cannot take an iterable AND a default value. The last argument would be the default value returned, but then you wouldn't be passing in an iterable in that case as well as it isn't explicit that the last argument is a default to value.

You could then do below, but I'd still use not_null for the single value use case.

def coalesce(*args, **kwargs):
    return next((a for a in args if a is not None), kwargs.get('default'))

Comments

0

There's no ?? operator in Python but the usual approach is:

# Using 'or'
s = None
other = s or "default"

# Using conditional expression
other = s if s is not None else "default"

If you want a helper function similar to SQL’s NVL or COALESCE, you can use pynvl-lib (disclaimer: I’m the author):

from pynvl import nvl, coalesce

print(nvl(None, 5))      # 5

print(nvl("hello", 99))  # 'hello'

#Coalesce is there too:

port_address = None
ip_address = None
mac_address = "A1:B2:C3:D4:E5:F6"
print(coalesce(port_address, ip_address, mac_address)) # "A1:B2:C3:D4:E5:F6"

1 Comment

As it’s currently written, your answer is unclear. Please edit to add additional details that will help others understand how this addresses the question asked. You can find more information on how to write good answers in the help center.
-3
Python has a get function that its very useful to return a value of an existent key, if the key exist;
if not it will return a default value.

def main():
    names = ['Jack','Maria','Betsy','James','Jack']
    names_repeated = dict()
    default_value = 0

    for find_name in names:
        names_repeated[find_name] = names_repeated.get(find_name, default_value) + 1

if you cannot find the name inside the dictionary, it will return the default_value, if the name exist then it will add any existing value with 1.

hope this can help

1 Comment

Hi, welcome to Stack Overflow. What new information does your answer add which wasn't already covered by existing answers? See @Craig's answer for example
-3

For those like me that stumbled here looking for a viable solution to this issue, when the variable might be undefined, the closest i got is:

if 'variablename' in globals() and ((variablename or False) == True):
  print('variable exists and it\'s true')
else:
  print('variable doesn\'t exist, or it\'s false')

Note that a string is needed when checking in globals, but afterwards the actual variable is used when checking for value.

More on variable existence: How do I check if a variable exists?

1 Comment

(variablename or False) == True is the same as variablename == True
-6

The two functions below I have found to be very useful when dealing with many variable testing cases.

def nz(value, none_value, strict=True):
    ''' This function is named after an old VBA function. It returns a default
        value if the passed in value is None. If strict is False it will
        treat an empty string as None as well.

        example:
        x = None
        nz(x,"hello")
        --> "hello"
        nz(x,"")
        --> ""
        y = ""   
        nz(y,"hello")
        --> ""
        nz(y,"hello", False)
        --> "hello" '''

    if value is None and strict:
        return_val = none_value
    elif strict and value is not None:
        return_val = value
    elif not strict and not is_not_null(value):
        return_val = none_value
    else:
        return_val = value
    return return_val 

def is_not_null(value):
    ''' test for None and empty string '''
    return value is not None and len(str(value)) > 0

1 Comment

This kind of things adds a whole bunch of slightly different terminology (e.g. "null" and "nz" neither of which mean anything in the context of Python), imported from other languages, plus with variants (strict or non-strict!). This only adds confusion. Explicit "is None" checks are what you should be using. Plus you don't get the benefit of any short-cutting semantics that operators can do when you use a function call.

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Start asking to get answers

Find the answer to your question by asking.

Ask question

Explore related questions

See similar questions with these tags.