Computation used to train notable artificial intelligence systems”

Author

math4mad

load pacakge

Code
using CairoMakie,CSV,DataFrames,Pipe,Tidier,HypertextLiteral
using MakieThemes
using StatsBase
using AlgebraOfGraphics
Makie.set_theme!(ggthemr(:dust))

2. load data->dataframe

Code
df=@pipe CSV.File("./data/artificial-intelligence-training-computation.csv")|>DataFrame
df=coalesce.(df, 0.0)
rename!(df,"Training computation (petaFLOP)"=>:petaFLOP)
df=@pipe sort(df,:petaFLOP;rev=true)|>first(_,40)
40×5 DataFrame
15 rows omitted
Row Entity Code Day petaFLOP Domain
String Float64 Date Float64 String15
1 GPT-4 0.0 2023-03-15 2.1e10 Multimodal
2 PaLM 2 0.0 2023-05-10 7.34e9 Language
3 Claude 2 0.0 2023-07-11 3.87e9 Language
4 Falcon 180B 0.0 2023-09-06 3.78e9 Language
5 Minerva (540B) 0.0 2022-06-29 2.74e9 Language
6 GPT-3.5 (text-davinci-003) 0.0 2022-11-28 2.58e9 Language
7 PaLM (540B) 0.0 2022-04-04 2.53e9 Language
8 Megatron-Turing NLG 530B 0.0 2021-10-11 1.17e9 Language
9 ERNIE 3.0 Titan 0.0 2021-12-23 1.04e9 Language
10 Llama 2 0.0 2023-07-18 8.1e8 Language
11 Gopher (280B) 0.0 2021-12-08 6.31e8 Language
12 Megatron-BERT 0.0 2019-09-17 6.03e8 Language
13 Chinchilla 0.0 2022-03-29 5.76e8 Language
29 BloombergGPT 0.0 2023-03-30 2.36e8 Language
30 ALIGN 0.0 2021-06-11 2.15e8 Multimodal
31 AlexaTM 20B 0.0 2022-08-02 2.04e8 Language
32 AlphaStar 0.0 2019-10-30 2.02e8 Games
33 BLOOM 0.0 2022-11-08 1.8e8 Language
34 AlphaGo Master 0.0 2017-01-01 1.5e8 Games
35 HyperClova 0.0 2021-09-10 1.48e8 Language
36 Meena 0.0 2020-01-28 1.12e8 Language
37 StarCoder 0.0 2023-05-09 1.12e8 Language
38 GPT-NeoX-20B 0.0 2022-02-09 9.32e7 Language
39 CoAtNet 0.0 2021-06-09 8.5e7 Vision
40 BASIC-L 0.0 2021-11-19 8.3e7 Vision
Code
axis = (width = 600, height =300,xticklabelrotation = pi/8,title="Computation used to train notable artificial intelligence systems")
data_layer = data(df)
mapping_layer=mapping(:Day,:petaFLOP,color=:Domain)
visual_layer = visual(Scatter;stroke=1,strokecolor=(:red,0.8),markersize=18)
draw(data_layer * mapping_layer * visual_layer,axis=axis)
┌ Warning: Keyword argument `bgcolor` is deprecated, use `backgroundcolor` instead.
└ @ Makie ~/.julia/packages/Makie/RgxaV/src/makielayout/blocks/legend.jl:23