Usually they build half of the new bridge first - usually what will eventually be the lanes for one direction. Then, they shift traffic to the new bridge (traffic both ways in the interim) and then tear down the old bridge and build the second half of the new bridge in its place. Now the new bridge is technically two new bridges, one in each direction.