e to do 表示计划要干什么事
they were not to take him seriously 应该有点过去将来时的意味
they did not take him seriously 则只是过去时了
个人理解