Here’s What Happens When Your Lawyer Uses ChatGPT

[Wargames]

If you make a custom GPT and upload the proper documents it will give legal word vomit you can edit into a decent statement of facts . You maybe can use it to evaluate other cases but you would still have to do a lot of writing to make sure the right cases are being quoted and everything forms the argument you want to make. Same for writing an application.

The issue is Lexis and Westlaw got all the data, and they arent dumb, they wont let the ai replace lawyers because lawyers pay them exorbitant fees. It takes just as much billable hours now as then, and is essentially a template builder.

It's not going to replace a lawyer anytime soon. I mean shyt I wouldn't fully trust it to create a case grid, let alone something I am putting in front of a judge. Like I said before you end up spending time editing instead of writing and like most AI I think that is the end result, now instead of writing briefs you have to edit them.

 

[bnew]

If you make a custom GPT and upload the proper documents it will give legal word vomit you can edit into a decent statement of facts . You maybe can use it to evaluate other cases but you would still have to do a lot of writing to make sure the right cases are being quoted and everything forms the argument you want to make. Same for writing an application.

The issue is Lexis and Westlaw got all the data, and they arent dumb, they wont let the ai replace lawyers because lawyers pay them exorbitant fees. It takes just as much billable hours now as then, and is essentially a template builder.

It's not going to replace a lawyer anytime soon. I mean shyt I wouldn't fully trust it to create a case grid, let alone something I am putting in front of a judge. Like I said before you end up spending time editing instead of writing and like most AI I think that is the end something instead of writing briefs you have to edit them.

are you using one type of model?

 

[Wargames]

are you using one type of model?

Unfortunately, I don't have the time to explore different models. It's not a word issue it's a content issue. Sure It can synthesize cases but can it apply multiple cases to various facts and then make the argument that overall this is why precedent says the rule should be interpreted in my clients favor? My whole brief is me just building a cohesive argument, using little passive aggressive things to try and reiterate my point of view and undercut what I think opposing counsel is trying to do. That is a lot to ask of a LLM.

You could break it up, use different prompts, review different results, and get what you want, but then you still got to use your own judgement and sew it all back together. It’s gonna take the same amount of time, and Westlaw and Lexis still gonna get their cut. Dont even get me started on the legal terms that LLM and spell check will autocorrect, but have actual legal meaning.

 

[bnew]

Unfortunately, I don't have the time to explore different models. It's not a word issue it's a content issue. Sure It can synthesize cases but can it apply multiple cases to various facts and then make the argument that overall this is why precedent says the rule should be interpreted in my clients favor? My whole brief is me just building a cohesive argument, using little passive aggressive things to try and reiterate my point of view and undercut what I think opposing counsel is trying to do. That is a lot to ask of a LLM.

You could break it up, use different prompts, review different results, and get what you want, but then you still got to use your own judgement and sew it all back together. It’s gonna take the same amount of time, and Westlaw and Lexis still gonna get their cut. Dont even get me started on the legal terms that LLM and spell check will autocorrect, but have actual legal meaning.

thats insightful

make use of double quotes for uncommon terms and even names. do you have some dummy data as an example or prompt you can share?

try a system prompt like "do not autocorrect or modify any words" or "do not autocorrect or modify any words, assume uncommon words are legal terms."

edit:
generated by clause 3 haiku
Prompt:
I am providing you with a legal document that contains specialized terminology, including Latin phrases. Please analyze the document, but do not attempt to correct, modify, or autocorrect any of the legal or Latin terms, even if they appear misspelled or unconventional. Preserve the original language and formatting of the document exactly as it is presented. Treat all Latin and legal phrases as intentional and do not make any changes to them. Provide your analysis while strictly maintaining the integrity of the legal terminology and formatting.

 

[Wargames]

thats insightful

make use of double quotes for uncommon terms and even names. do you have some dummy data as an example or prompt you can share?

try a system prompt like "do not autocorrect or modify any words" or "do not autocorrect or modify any words, assume uncommon words are legal terms."

Can you explain the double quotes for uncommon terms? I’m willing to give it a try. I still think the content/logic/subtle subversive aspects of legal writing is outside the scope but this could help.

 

[bnew]

Can you explain the double quotes for uncommon terms? I’m willing to give it a try. I still think the content/logic/subtle subversive aspects of legal writing is outside the scope but this could help.

use double quotes or even single quotes to be explicit about what you're referring to so it doesn't attempt to autocorrect anything and feed it additional context.

https://labs.perplexity.ai/

used the claude haiku model


you have to provide context and specify key terms and names in your prompts to reduce hallucinations.

edit:
partial screenshot of text

you don't have to use double quotes for the same word repeate4dly like I did above but once or twice should be enough to get the point across. you might want to look into find and replace browser extensions for the batch processing words in quotations.


I amended the other prompt:
I am providing you with a legal document that contains specialized terminology, including Latin phrases. Please analyze the document, but do not attempt to correct, modify, or autocorrect any of the legal or Latin terms, even if they appear misspelled or unconventional. Preserve the original language and formatting of the document exactly as it is presented. Treat all Latin and legal phrases as intentional and do not make any changes to them. Provide your analysis while strictly maintaining the integrity of the legal terminology and formatting. REPLY WITH: [To get started, please go ahead and provide the specific legal document(s) you would like me to analyze. I will be sure to follow the instructions you've outlined above and preserve the original language, even if it includes unusual legal or Latin terms.]

---

you would start off with that prompt and then after it replies, start chatting.

 

[bnew]

@Wargames see if you find this useful
created by claude3 haiku

Here is a more comprehensive, generic prompt for using an AI system like ChatGPT to assist with legal document drafting:

I am an attorney working on a [type of legal matter, e.g. civil litigation, corporate transaction, etc.] and I need your help drafting a [specific legal document, e.g. motion to dismiss, merger agreement, etc.].

Please review the following case files, legal documents, and examples that I have provided:
[List of relevant materials]

Using this information, I would like you to draft a [document type] that meets the following requirements:

Structure and Format:
- The document should be structured in the standard format and style expected by the [court/jurisdiction/industry standards], including appropriate sections, headings, and formatting.
- The tone and language should be professional, persuasive, and tailored to the intended audience (e.g. judge, opposing counsel, client, etc.).

Content Requirements:
1. Statement of Facts:
- Provide a detailed summary of the key facts and background information relevant to this matter, based on the provided case files.
- Ensure the facts are presented in a clear, logical, and compelling manner.

2. Legal Analysis:
- Identify the primary legal standards, precedents, and authorities that apply to this case or transaction.
- Summarize the key elements of the relevant law and how they relate to the facts of this matter.
- Outline the main legal arguments, reasoning, and conclusions that support the desired outcome.

3. Requested Relief/Outcome:
- Clearly state the specific legal action or outcome being sought (e.g. dismissal of claims, approval of merger, etc.).
- Explain how the presented facts and legal analysis justify the requested relief.

4. Additional Considerations:
- Flag any areas where you are unsure or believe human review and refinement would be beneficial.
- Explain your reasoning and decision-making process for the key elements of the document, such as the legal arguments, case law citations, and overall strategy.

Please provide an initial draft of the [document type] based on the instructions above. I will review your work and provide feedback. We can then collaborate to refine and finalize the document to ensure it meets all requirements and presents the strongest possible case.

Let me know if you have any other questions as you work on this project. I'm here to provide guidance and support throughout the drafting process.

OR​

Got it, here's an updated comprehensive prompt that requires the user to provide the relevant legal documents after the initial prompt:

"I am an attorney working on a [type of legal matter, e.g. civil litigation, corporate transaction, etc.] and I need your help drafting a [specific legal document, e.g. motion to dismiss, merger agreement, etc.].

Please provide the following case files, legal documents, and examples that I will need for this project:
[Prompt user to enter list of relevant materials]

Once you have provided those materials, I would like you to draft a [document type] that meets the following requirements:

Structure and Format:
- The document should be structured in the standard format and style expected by the [court/jurisdiction/industry standards], including appropriate sections, headings, and formatting.
- The tone and language should be professional, persuasive, and tailored to the intended audience (e.g. judge, opposing counsel, client, etc.).

Content Requirements:
1. Statement of Facts:
- Provide a detailed summary of the key facts and background information relevant to this matter, based on the provided case files.
- Ensure the facts are presented in a clear, logical, and compelling manner.

2. Legal Analysis:
- Identify the primary legal standards, precedents, and authorities that apply to this case or transaction.
- Summarize the key elements of the relevant law and how they relate to the facts of this matter.
- Outline the main legal arguments, reasoning, and conclusions that support the desired outcome.

3. Requested Relief/Outcome:
- Clearly state the specific legal action or outcome being sought (e.g. dismissal of claims, approval of merger, etc.).
- Explain how the presented facts and legal analysis justify the requested relief.

4. Additional Considerations:
- Flag any areas where you are unsure or believe human review and refinement would be beneficial.
- Explain your reasoning and decision-making process for the key elements of the document, such as the legal arguments, case law citations, and overall strategy.

Please provide an initial draft of the [document type] based on the instructions above and the materials you have provided. I will review your work and provide feedback. We can then collaborate to refine and finalize the document to ensure it meets all requirements and presents the strongest possible case.

---

Here is the updated prompt that requires the user to provide the necessary legal documents and materials:

Using the provided case files, legal documents, and examples, please draft a [type of legal document, e.g. motion to dismiss] for the [case name/details].

First, please provide the following case files, legal documents, and examples that I will need for this project:
[Prompt user to enter list of relevant materials]

Once you have provided those materials, please proceed with drafting the [document type] as follows:

1. Provide a detailed statement of facts based on the provided case information.

2. Summarize the key legal standards, precedents, and authorities that are most relevant to this case.

3. Outline the main arguments and reasoning for why [requested legal action, e.g. dismissal] is warranted, citing the applicable law and precedents.

4. Structure the document in the appropriate format and tone for submission to the [court/jurisdiction].

5. Highlight any areas where you are unsure or where you believe human review and refinement would be beneficial.

6. Explain your reasoning and decision-making process for the key elements of the document, such as the legal arguments, case law citations, and overall strategy.

Please provide this in draft form initially. I will review your work, provide feedback, and then ask you to revise and refine the document based on my input. The goal is to collaborate and iterate to produce a high-quality, legally sound [document type] that meets the court's requirements.

 

[bnew]

@Wargames

has LLM's improved for the tasks you give it?

 

[bnew]

Spoiler: thread continued

Spoiler: full text & large images

1/22
@JamesSurowiecki
Just figured out where these fake tariff rates come from. They didn't actually calculate tariff rates + non-tariff barriers, as they say they did. Instead, for every country, they just took our trade deficit with that country and divided it by the country's exports to us.

So we have a $17.9 billion trade deficit with Indonesia. Its exports to us are $28 billion. $17.9/$28 = 64%, which Trump claims is the tariff rate Indonesia charges us. What extraordinary nonsense this is.

[Quoted tweet]
It's also important to understand that the tariff rates that foreign countries are supposedly charging us are just made-up numbers. South Korea, with which we have a trade agreement, is not charging a 50% tariff on U.S. exports. Nor is the EU charging a 39% tariff.

2/22
@JamesSurowiecki
Even given that it's Trump, I cannot believe they said "We'll just divide the trade deficit by imports and tell people that's the tariff rate." And then they decided to set our tariffs by just cutting that totally made-up rate in half! This is so dumb and deceptive.



3/22
@JamesSurowiecki
How in God's name did Scott Bessent agree to sign off on this?



4/22
@JamesSurowiecki
This tweet is correct, but it's actually worse than I thought: in calculating the tariff rate, Trump's people only used the trade deficit in goods. So even though we run a trade surplus in services with the world, those exports don't count as far as Trump is concerned.
https://nitter.poast.org/JamesSurowiecki/status/1907559189234196942



5/22
@Psychonaut1001
I’m Australian,
America has a trade SURPLUS with us, and they’ve STILL put a 10% tariff on us.



6/22
@JamesSurowiecki
Yes, any country where we have a trade surplus or where the trade deficit/imports is less than 10% had their tariff rate listed as 10%.



7/22
@orthonormalist


[Quoted tweet]
DID I CRACK IT?

I think I figured out at least a chunk of the math.

It's trade deficit divided by their exports.

EU: exports 531.6, imports 333.4, deficit 198.2. 198.2/531.6 is 37, close to 39.

Israel: exports 22.2, imports 14.8, deficit 7.4. 7.4/22.2 is 33.


8/22
@JamesSurowiecki
They're also only looking at goods, so even though we run a massive services surplus with the world, that didn't count when they calculated these imaginary "tariff rates."



9/22
@mdangremond
How many calculations have you checked?



10/22
@JamesSurowiecki
A few. But it's obviously right. Look at the UK. The UK has a 20% VAT, which Trump says counts as a non-tariff barrier. But its tariff rate is supposedly only 10%. That's because our balance of trade with the UK is almost even, and all countries are listed as having at least a 10% tariff rate.



11/22
@SpencerHakimian
You cannot be serious.



12/22
@JamesSurowiecki
Amazingly, I am. They're also only looking at goods. So even though we run a massive services surplus with the world, Trump just ignored that when calculating the "tariff rate."



13/22
@JamesGozzi
Nonsense that is going to work.

Argentina - Removed all tariffs
Vietnam - Removed all tariffs
Israel - Removed all tariffs
Canada - Moving toward no tariffs
Mexico - No tariffs planned
India - Considering reducing tariffs
EU - Planning retaliation
Australia - No tariffs planned



14/22
@JamesSurowiecki
Do you anticipate American companies doing a lot of exporting to Vietnam now?



15/22
@Phili_Thomp
That's why some countries are charged less than their actual MFN rate

Turkey, 16.2%, 10% Trump rate
Argentina, 13.4%, 10% Trump rate
Morocco, 14%, 10% Trump rate

For what it's worth (nothing) there is a U.S.- FTA with Morocco... And it's the Mexico carmaker for Europe



16/22
@JamesSurowiecki
Yes - if our balance of trade with a country is roughly even (or trade deficit/imports is less than 10%), they're listed as 10%.



17/22
@ChrisKartalia
If the rates are inflated, all the easier for countries to “cut” them, Trump claims a win, and gets the 10% ongoing rate that he really wants



18/22
@JamesSurowiecki
In some cases, the rates listed are less than the rates countries actually charge, because we run a small trade deficit with them, and if trade deficit/imports is less than 10%, Trump just listed their tariff rate as 10%.



19/22
@0xKingAlex
This is pure cope. The chart includes tariffs and non-tariff barriers, VATs, currency manipulation, import bans, regs, etc.

You’re pretending it’s just deficit math to gaslight. It’s not. It’s reciprocity.

If they tax us 40%, we tax them 40%. Simple.



20/22
@JamesSurowiecki
Will you stop? They're not taxing us 40%. That's an imaginary number. The "tariff rates" in that chart are literally just our trade deficit in goods with a country/our imports from that country. They don't reflect actual tariffs + non-tariff barriers.



21/22
@wightmanr
Hrm... not disagreeing that the rates are fake / nonsense... but feels more arbitrary than suggested. EU for instance, the trade imbalance is only ~3% of the total trade if you factor in goods and services. The 20% seems closer to the VAT, which is also completely moronic to consider a tariff given that it applies to foreign and domestic goods equally... I think the average tariff rate in both directions up until now was about 1% in both directions.... regardless, WTF, where are the adults in the room?



22/22
@JamesSurowiecki
As I said later in the thread, they ignored services when calculating the "tariff rates." They only looked at goods.




To post tweets in this format, more info here: https://www.thecoli.com/threads/tips-and-tricks-for-posting-the-coli-megathread.984734/post-52211196

Spoiler: full text & large images

1/11
@quendergeer
oh my fukking god

[Quoted tweet]
they've just asked chatgpt to spit out a spreadsheet haven't they

2/11
@JapanDeepValue1

3/11
@0xrooter
they forgot to turn on deep research



4/11
@thisiswenzel
Haha, I'm dead.



5/11
@georgia_genx
And now Musk is leaving... lol



6/11
@Rafi_0x
We’re 100% living in a simulation, there’s no other explanation



7/11
@SantiagoPombo
I thought I was kidding:

[Quoted tweet]
Liberation Day Tariffs, Tech Edition:
Vibe coders seized the global codebase, rewrote the economy in one untested commit with zero coverage and no rollback plan, via "git push --force" to main. Servers are melting.

README: "Trust the vibes"


8/11
@stoitz
So funny, I was wondering why they had separate tariffs on St Pierre and Miquelon



9/11
@ISpotLies
The island populated by penguiks is owned by Australia and to avoid tariffs Australia could just send exports through the island. That's why it was listed actually.



10/11
@RyanPMcGowan
Low info post masquerading as high info.



11/11
@xDreamCoding
Vibe governing




To post tweets in this format, more info here: https://www.thecoli.com/threads/tips-and-tricks-for-posting-the-coli-megathread.984734/post-52211196

Spoiler: text

Commented on Thu Apr 3 19:13:33 2025 UTC

You can tell they used Ai , they put tarrifs on islands that don’t even have people on them.

│
│

Spoiler: text

│ Commented on Thu Apr 3 20:05:32 2025 UTC
│
│ Stable Genius Trump Just Put Tariffs on a U.S. Military Base.
│

 

[Rev Leon Lonnie Love]

Buu buu but AI gonna take all our jobs

 

[bnew]

Buu buu but AI gonna take all our jobs

it will but it's a tool right now and if you don't know how to use the tool to produce results you want it's not entirely the fault of said tool.

garbage in, garbage out.

 

[Rev Leon Lonnie Love]

it will but it's a tool right now and if you don't know how to use the tool to produce results you want it's not entirely the fault of said tool.

garbage in, garbage out.

that shyt will never happen