Figure out where your property ends. If the tree is on your property then the answer is obvious. The only other thing to screw it up is some places the property line falls on the middle of the road and the county has an easement for the road.
Any R/W signs along the road? Any right of way signs usually indicate the property boundary.
Old plats (or no plats) may show property lines going to the center of the road, but in my experience as a planner, the Right-of-Way (ROW) determines your front property line, and that is usually well-back from the pavement. For instance, a 40 ft ROW will be 12' of pavement on either side of the middle of the road (2 lane road), and 8' for utility easements on either side. They may include drainage, sidewalk, and lighting uses in the easement area. Sounds like the OP is in the country, and the area is unincorporated, so it's the county who has responsibility for maintenance of the ROW. If you have a sealed copy of your survey, the ROW and all lot lines should be shown.
When real property is platted, the developer usually deeds the ROW to the city, village, county or other governmental jurisdiction. They may also do that if the property needs land for utilities like a lift station, stormwater maintenance like retention ponds and drainage piping, or other uses like utilities and essential services (fire/rescue & PD).
You can probably go to the county engineering dept and request to see the plat map for your property area, and request a printed copy. It may be online in some areas, but you would need to get the source website and go to a blueprinting business to get a 24" x 36" printout made, to-scale.