从纯粹的词序上讲可以：
They neither called nor emailed us.
从英语的运用实际上将,若要表达“我们两人谁都没话”,他们说：
Neither of us said anything./Neither of us talked.
而不是：
We neither said anything./We neither talked.
更不是：
We neither spoke.
也就是说,就你的句子而言
若：We neither spoke. (试图表达“我们两个人谁都不说话”,虽句子完整,句意也十分好懂,但不符合英语习惯.)
若：We neither spoke or wrote English. (可以.)