Yes. Whether the result is a good conductor depends on how localized electrons and holes in the respective bands are (or, saying the opposite phenomenologically: on their mobility). Their recombination time limits for how long you will have even just two charge carriers available for conduction. This tends to make such conduction very energy-inefficient because you have to use one or even many electronvolts of photon energy to create just one pair of short-lived charge carriers. In metals, you get on the order of Avogadro's number of conducting charge carriers for free!
As pointed out in comments, the result is a photoconductor. In a semiconductor, it is feasible to combine this with a diode, in which case you have a photodiode, also known as solar cell. It can be used to convert your photons into useable electric energy by separating the charges (but you can also use it with a reverse bias voltage applied to turn it into a better photon detector).