It's ironic because I never want to ask an LLM for something like your example general purpose question, where I can't just cheaply and directly test the correctness of the answer

But we're hurtling towards all the internet's answers to general purpose questions being SEO spam that was generated by an LLM anyways.

Since OpenAI probably isn't hiring as many HVAC technicians to answer queries as they are programmers, it feels like we're headed towards a death spiral where either having the LLM do actual research from non-SEO affected primary sources, or finding a human who's done that research will be the only options for generic knowledge questions that are off the beaten path

-

Actually to test my hypothesis I just tried this with ChatGPT with internet access.

The list of winterization tips cited an article that felt pretty "delvey". I search the author's name and their LinkedIn profile is about how they professionally write marketing content (nothing about HVAC), one of their accomplishments is Generative AI, and their like feed is full of AI mentions for writing content.

So ChatGPT is already at a place where when it searches for "citations", it's just spitting back out its own uncited answers above answers by actual experts (since the expert sources aren't as SEO-driven)

> I can't just cheaply and directly test the correctness of the answer

I feel that, but I think for me the key is knowing that LLMs can be wrong and I should treat the answer as a starting point and not an actual expert. I find it really helpful for topics where I don't even know where to start because, like you said, most search engines are utter trash now.

For things like that, I find ChatGPT to be a good diving off point. For example, this is what I got when I asked:

``` Preparing your townhouse for winter involves addressing common issues associated with the region's wet and cool climate. Here's a concise checklist to help you get started:

1. Exterior Maintenance

Roof Inspection: Check for damaged or missing shingles to prevent leaks during heavy rains.

Gutter Cleaning: Remove leaves and debris to ensure proper drainage and prevent water damage.

Downspouts: Ensure they direct water away from the foundation to prevent pooling and potential leaks.

Siding and Trim: Inspect for cracks or gaps and seal them to prevent moisture intrusion.

2. Windows and Doors

Weatherstripping: Install or replace to seal gaps and prevent drafts, improving energy efficiency.

Caulking: Apply around window and door frames to block moisture and cold air.

3. Heating System

Furnace Inspection: Have a professional service your furnace to ensure it's operating efficiently.

Filter Replacement: Change furnace filters to maintain good air quality and system performance.

4. Plumbing

Outdoor Faucets: Disconnect hoses and insulate faucets to prevent freezing.

Pipe Insulation: Insulate exposed pipes, especially in unheated areas, to prevent freezing and bursting.

5. Landscaping

Tree Trimming: Prune branches that could break under snow or ice and damage your property.

Drainage: Ensure the yard slopes away from the foundation to prevent water accumulation.

6. Safety Checks

Smoke and Carbon Monoxide Detectors: Test and replace batteries to ensure functionality.

Fireplace and Chimney: If applicable, have them inspected and cleaned to prevent fire hazards.

By addressing these areas, you can help protect your home from common winter-related issues in Seattle's climate. ```

Once I dove into the links ChatGPT provided I found the detail I needed and things I needed to investigate more, but it saved 30 minutes of pulling together a starting list from the top 5-10 articles on Google.

Super old comment, but for posterity, my point is that unfortunately increasingly when you do dive into those results those are also ChatGPT

Depends on the topic of course, but it ends up being a bit of an ouroborous