Guide to Gen AI Models
LlaMa 2
GPT Models
LaMDA
PaLM 2
Claude 2
Name: LLaMA (Large Language Model Meta AI)
Developer: Meta
Latest Version: LLaMA 2
Date Launched: LLaMA: Feb. 2023, LLaMA 2: July 2023
Price: Llama 2 is available for free for research and commercial use. Supplemental costs vary depending on the API used.
How It’s Used in Legal: The industry’s use of Meta’s LLaMA is for now limited to a few players that have mentioned wanting to make their products “LLM agnostic” and potentially leverage LLaMA in the future, including UK-based law firm Travers Smith, Agiloft, Altumatim and Lupl.
Cloud partner: Amazon Web Services and Microsoft Azure
Closed or Open Source: Open Source
Name: GPT (Generative Pre-trained Transformers)
Developer: OpenAI
Latest Version: GPT-4 Turbo version announced on Nov. 6
Date Launched: GPT-3.5, March 2022; GPT-4, March 2023; GPT-4 Turbo, Nov. 6. 2023
Size: OpenAI declined to share the model’s parameters.Context Window: 128,000 tokens – in practice, this means it could fit the equivalent of more than 300 pages of text in a single prompt.
Price: Multiple models, each with different capabilities and price points. For GPT-4 Turbo, input costs are $0.01 per 1,000 tokens and output costs are $0.03 per 1,000 tokens. For GPT-4 Turbo, input costs are $0.01 per 1,000 tokens and output costs are $0.03 per 1,000 tokens.
How It’s Used in Legal: OpenAI’s GPT models are by far the most prevalent in the legal tech industry. They’re used by providers all across the spectrum, including by CLM vendors such as Evisort, ContractPodAi and Ironclad; e-discovery providers such as Relativity and Everlaw; and legal research providers including LexisNexis and Thomson Reuters
Cloud partner: Microsoft Azure
Closed or Open Source: Closed
Name: LaMDA (LaMDA: Language Models for Dialog Applications
Developer: Google
Latest Version: Second version
Date Launched: First version, May 2021; second version January 2022
Size: 2 Billion to 137 Billion Parameters
Price: N/A
How It’s Used in Legal: N/A
Cloud partner: Google
Closed or Open Source: Closed
Name: PaLM 2 (Pathways Language Model)
Developer: Google
Latest Version: PaLM 2 comes in four different sizes. Each size is named after an animal. From smallest to largest: Gecko, Otter, Bison and Unicorn
Date Launched: PaLM - April 2022; PaLM 2 - May 2023
Size: PaLM 1 is up to 540 billion parameters, and PaLM 2 is up to 340 billion parameters, according to CNBC. PaLM 2 via the PaLM API has a context window of 8,000 tokens
Price: N/A
How It’s Used in Legal: At least one legal tech company has publicly disclosed that they are specifically using PaLM 2 in their offerings. E- discovery software provider Altumatim noted that its Autonomous Review product leverages PaLM 2, among other LLMs.
Cloud partner: Google Cloud
Closed or Open Source: Closed
Name: Gemini
Developer: Google
Latest Version: 1.0
Date Launched: Announced Dec. 6, 2023, with availability for developers and enterprise customers starting on Dec. 13, 2023
Size: Gemini comes in three sizes. From smallest to largest: Gemini Nano, Gemini Pro and Gemini Ultra. Gemini Nano’s size is up to 3.25 billion parameters. The parameter sizes for the other Gemini Pro and Gemini Ultra is unknown.
Price: N/A
How It’s Used in Legal: The parameter sizes for the other Gemini Pro and Gemini Ultra are unknown.
Cloud partner: Google
Closed or Open Source: Closed
Click on pie segments for more info for each model
Information valid as of December 1, 2023.
Home
Gemini
Name: Claude 2
Developer: Anthropic
Latest Version: Claude 2
Date Launched: July 2023
Size: PaLm 1 is up to 540 Billion Parameters, and PaLM 2 is Up to 340 Billion Parameters, according to CNBC
Price: Prompt is $11.02/million tokens; Completion (text model generates) is $32.68/million tokens.
How It’s Used in Legal: To date, it is publicly known that London-based contract provider Robin AI, LexisNexis’s generative artificial intelligence platform Lexis+ AI, London-based legal tech company Genie AI’s legal assistant and E- discovery software provider Altumatim all leverage the Claude model
Cloud partner: Google and Amazon
Closed or Open Source: Closed
Name: GPT (Generative Pre-trained Transformers)
Developer: OpenAI
Latest Version: GPT-4 Turbo version announced on Nov. 6
Date Launched: GPT-3.5, March 2022; GPT-4, March 2023; GPT-4 Turbo, Nov. 6. 2023
Size: OpenAI declined to share the model’s parameters.Context Window: 128,000 tokens - in practice, this means it could fit the equivalent of more than 300 pages of text in a single prompt.
Price: Multiple models, each with different capabilities and price points. For GPT-4 Turbo, input costs are $0.01 per 1,000 tokens and output costs are $0.03 per 1,000 tokens. For GPT-4 Turbo, input costs are $0.01 per 1,000 tokens and output costs are $0.03 per 1,000 tokens.
How It’s Used in Legal: OpenAI’s GPT models are by far the most prevalent in the legal tech industry. They’re used by providers all across the spectrum, including by CLM vendors such as Evisort, ContractPodAi and Ironclad; e-discovery providers such as Relativity and Everlaw; and legal research providers including LexisNexis and Thomson Reuters
Cloud partner: Microsoft Azure
Closed or Open Source: Closed