In a basic triplex system, it only takes two failures to bring down the system (either the two faulty units outvote the healthy one or you get three different answers and direct law is invoked). It's been a while since we had those, though. Even the space shuttle had four primary computers and a completely independently built fifth backup.
Modern Airbus use 5 computers, each of which actually has two computers inside and any unit will cut itself off (fail passive) if the command computer disagrees with the partner monitor channel.
I believe that Boeing use 3 computers, each with 3 channels (one command, two monitors) with a similar approach.
At least one computer will be somewhere different on the aircraft - I think Airbus spread them out more than Boeing. This means that a fire or object strike doesn't take out all FBW capability. You then have to consider power supplies, cooling, etc to ensure all single point failures are removed.