Judge rebukes law firm using ChatGPT to justify $113,484.62 fee as “utterly and unusually unpersuasive”::Use of AI to calculate legal bill ‘utterly and unusually unpersuasive’

  • Ephera@lemmy.ml
    link
    fedilink
    English
    arrow-up
    30
    ·
    9 months ago

    🤔 I should write a program which always outputs a big number.

    How much should we charge our customers?

    113,484.62

    How many programmers did it take to create this AI?

    113,484.62

    What’s 2+2?

    113,484.62

    It just always gives you the legal advice you need.

  • AutoTL;DR@lemmings.worldB
    link
    fedilink
    English
    arrow-up
    13
    ·
    9 months ago

    This is the best summary I could come up with:


    The legal eagles at New York-based Cuddy Law tried using OpenAI’s chatbot, despite its penchant for lying and spouting nonsense, to help justify their hefty fees for a recently won trial, a sum the losing side is expected to pay.

    NYC federal district Judge Paul Engelmayer, however, rejected the submitted amount, awarded less than half of what Cuddy requested, and added a sharp rebuke to the lawyers for using ChatGPT to cross-check the figures.

    The briefs basically cited ChatGPT’s output to support their stated hourly rate, which does depend on things like the level and amount of research, preparation, and other work involved.

    Cuddy told the court “its requested hourly rates are supported by feedback it received from the artificial intelligence tool ‘ChatGPT-4,’” Engelmayer wrote in his order [PDF], referring to the GPT-4 version of OpenAI’s bot.

    “As the firm should have appreciated, treating ChatGPT’s conclusions as a useful gauge of the reasonable billing rate for the work of a lawyer with a particular background carrying out a bespoke assignment for a client in a niche practice area was misbegotten at the jump,” Judge Engelmayer said.

    Benjamin Kopp, a lawyer at Cuddy Law, told The Register his firm’s use of AI wasn’t anything like cases that fabricated court documents; this particular situation had nothing to do with influencing the legal process.


    The original article contains 671 words, the summary contains 221 words. Saved 67%. I’m a bot and I’m open source!

    • Dave@lemmy.nz
      link
      fedilink
      English
      arrow-up
      25
      ·
      edit-2
      9 months ago

      I’ve asked ChatGPT to explain maths to me before. I can’t remember what it was but it was something when I knew the answer and was trying to calculate the starting value.

      It told me the answer and I asked for the explanation. It went something like this (not actual, just a tribute):

      • Step 1: 1 + 1 = 2
      • Step 2: 2 * 2 = 4
      • Step 3: 4 / 8 = 0.5

      Me: Uh, the answer is supposed to be 9,000,000.

      ChatGPT: Sorry, it seems you are right. Here’s the corrected version:

      • Step 1: 1 + 1 = 2
      • Step 2: 2 * 2 = 4
      • Step 3: 4 / 8 = 9,000,000
      • Hamartiogonic
        link
        fedilink
        English
        arrow-up
        3
        ·
        9 months ago

        Sometimes GPT says it’s using the correct values, but somehow gets the wrong answer regardless. Also the opposite happens frequently, and that’s when I realized I was pushing it too hard.

        Don’t ask it to calculate the ratio between the surface areas of the Moon and Earth. Instead, ask what are the relevant radiuses are and calculate everything yourself.

      • berg@lemm.ee
        link
        fedilink
        English
        arrow-up
        3
        arrow-down
        1
        ·
        9 months ago

        So it did it correctly but you told it to hallucinate? Or did it just fail from the get to?

        It really isn’t great at math, but I’ve had okay results for equations where common integrals/trigonometry is used. It’s quite easy to spot the mistakes and can lead you to the answer even if it’s wrong in the explanation. Pretty much like how it can hallucinate while programming but still end up useful.

        WolframAlpha is still my go to though if I’m lazy. But I haven’t payed for it in ages.

        • Dave@lemmy.nz
          link
          fedilink
          English
          arrow-up
          6
          ·
          9 months ago

          It was a question like where I knew the answer and needed the correct value to put in the equation to get that end result. I wish there was a better way to search previous chats because it would help if I could remember the context. But anyway, the first time it got the maths right from the starting value to the ending value, but it didn’t actually answer the question because the ending value was not the one I asked for. It was as good as if it gave me a random answer.

          I pointed out that it hadn’t answered the question, and that’s when it just changed the last step to make it the answer I was looking for. It was supposed to adjust the starting value to make it have the correct outcome.

          • lad@programming.dev
            link
            fedilink
            English
            arrow-up
            2
            ·
            9 months ago

            Yeah, I think what you needed was something of an inverse problem solution, for some calculations it may be quite hard to compute. Were you successful in finding the starting value without ChatGPT’s help?

            • Dave@lemmy.nz
              link
              fedilink
              English
              arrow-up
              2
              ·
              9 months ago

              I can’t remember! It was probably a year ago, but knowing me I probably tried random starting numbers until I got the answer I wanted.

    • Gormadt@lemmy.blahaj.zone
      link
      fedilink
      English
      arrow-up
      3
      ·
      9 months ago

      ChatGPT ain’t good at moth from what I keep hearing.

      For quick short hand for X generations it’s been in the family: 30 years per generation is a good short hand.

      For example: 1 generation is me (30), 2 generations is my dad(60), 3 generations is grandpa(90), 4 generations is great-grandpa(120), etc.

      • Albbi@lemmy.ca
        link
        fedilink
        English
        arrow-up
        4
        ·
        9 months ago

        Well lookie at this highborn noble we got here! 30 year generations PAH! 15 years is how we do it. I coulda met my great great grandma if all that smokin’ didn’t do her in with emphysema.

        • Gormadt@lemmy.blahaj.zone
          link
          fedilink
          English
          arrow-up
          3
          ·
          9 months ago

          Lol

          Honestly my family’s generations are much closer than my example, it’s just round numbers in my example for simple math

          Mine are closer to 20 and past the last 2, the lower side of 20. And one generation awhile back was… Too close by a good margin of you catch my meaning.

          Great great grandpa was an odd duck when I met him but he was a hoot

  • JackGreenEarth@lemm.ee
    link
    fedilink
    English
    arrow-up
    11
    arrow-down
    2
    ·
    9 months ago

    Bing Chat is good at maths as it has a special maths addon, but most normal LLMs aren’t