Alright, so here's the answer.
Alcohol torch was pretty close, but the actual name is "Blow Pipe" (no their not for smoking anything)
This one is missing a rubber tube that should be attached to the thing on the side.
They would be filled with alcohol, and the wick would be lit, and then you would blow lightly through the hose onto the flame.
The blowing, of course, produced a much hotter flame than just letting it burn.
They could be used for soldering small items, or anything like that.
Larger versions that worked on the same principle were used in laboratories.