The penalty means that the Russian driver drops to 11th out of the points, promoting Hulkenberg into tenth place.
The two were fighting for ninth place, with Kvyat trying to pull his car alongside Hulkenberg's as they made their way into the final corner, which pitched the latter into the wall.
Hulkenberg managed to get his car pointing the right way again and cross the line in 11th place.
Pierre Gasly in the other Toro Rosso also crossed the line inside the top ten, and was classified as ninth.
Bahrain International Circuit - Winter testing