Stephen Colbert took a brief leave of absence when his mother passed away last week.