We have examined graphene absorption in a range of graphene-based infrared devices that combine either monolayer or bilayer graphene with three different gate dielectrics. Electromagnetic simulations show that the optical absorption in graphene in these devices, an important factor in a functional graphene-based detector, is strongly dielectric-dependent. These simulations reveal that plasmonic excitation in graphene can significantly influence the percentage of light absorbed in the entire device, as well as the graphene layer itself, with graphene absorption exceeding 25% in regions where plasmonic excitation occurs. Notably, the dielectric environment of graphene has a dramatic influence on the strength and wavelength range over which the plasmons can be excited, making dielectric choice paramount to final detector tunability and sensitivity.