Can i focus to infinity?

I have two entry level lenses (nikkor 18-55mm vr & 55-300 vr). They both have the little figure 8 symbol on them but don't have that window thing. Can they focus to infinity?

ps-excuse my poor terminology, i'm a noob

Added (1). Well does anyone know how to focus to infinity on them?

That is the infinity symbol. So yes.

Yes, that is exactly what that means. Virtually any lens you'll ever buy can focus to "infinity."

Pick a distant object (faaaaar away) and focus as you normally do. Use AF and the camera will do it for you.
Try it at moon at night.

Yes they can.

Switch to manual focus, turn the focus ring & line up the infinity symbol.

Yes, you can focus to infinity with both lenses.

The little figure 8 sideways thingy is the only symbol for infinity that I know, so you have taught me that there must be another symbol for infinity. On all lenses that I have seen in 50 years the '8' symbol means infinity.

So if you are focusing manually use that sideways '8' to focus to infinity. Or autofocus. Note that autofocus is not good on a clear blue sky with a small aeroplane as the only object.