With several processes running (external) tests, if not os.path.exists(self.cache_location): can return True while the dir is being made, leading to a crash on the following line. Instead, use os.makedirs(self.cache_location, exist_ok=True)