I Simulated 1,083,021 Battles to Find The Best Gen 1 Pokémon

Comments · 879

• SM

  @smithplayspokemon · 2 years ago (edited) · pinned

  Just a few notes based on some recurring comments I&apos;ve seen:<br><br>I think a lot of people are misinterpreting how we got movesets, saying things like &quot;x pokemon was missing x move&quot;. Every combination of moves with at least 1 damaging move available for each pokemon were tested at each trainer. We were not trying to find the BEST moveset, we were only determining if it could sweep. As mentioned in the video, if a non perfect moveset is tested and it sweeps 3 times in a row, it moves on from that pokemon because obviously a better moveset will still sweep. If a &quot;worse&quot; moveset is tested and it can take out 4/5 pokemon, then another &quot;better&quot; moveset still can only take out 4/5 pokemon, it still keeps the first moveset to get that high score. It generally simply means &quot;better&quot; movesets didn&apos;t actually perform any better in that fight. So when you see pokemon with &quot;weird&quot; movesets, this is why. Remember only the top score moveset is kept, EVERY moveset was tested unless a pokemon got a perfect score for some moveset in which case the mon gets a perfect score and the rest are skipped.<br><br>I need to acknowledge that the AI is not perfect, we&apos;re still finding bugs and there&apos;s very likely situations I haven&apos;t considered when coding it where it just does not know the correct thing to do. If you&apos;ve tried writing AI for pokemon yourself, you probably know it isn&apos;t an easy task, and requires many many iterations to get right. Currently known bugs include confusion moves being spammed, underestimating double/triple hit moves and dream eater looking at the wrong pokemon for sleep checks. Dragonair was also accidently given access at misty rather than surge and venusaur was accidently given earthquake, slightly boosting their rankings. If you find any more situations like this, please message us in the discord server, as this is where I&apos;m most likely to see it :)<br><br>The trainer’s AI is improved from the base game, and is the same as the player AI. This leads to results like charmander being unable to sweep brock. I can see this being a controversial decision but think about it this way, it takes the randomness down dramatically because the AI is not using completely random moves. This makes it feasible to actually run the simulations, because we require significantly less repeat battles. I&apos;d argue without running thousands of battles with a purely random AI you cannot get scientifically accurate results, and this is computationally infeasable. Also generally, if charmander cannot beat brock with decent AI and another pokemon can, of course the one that can is clearly the better pokemon. It is escentially taking into account the worst case scenareo for the original random gen 1 AI, so if they can beat good AI it shows they are consistent. It is even across all pokemon, so the ranking holds.<br><br>Our ranking does not take into account grinding time. This is a very fair point, while dragonite can sweep all of blue’s teams, it’s very difficult to get it to a level on par. Our ranking goes by level cap with no stat exp, so in theory dragonite at level cap is more equivalent to a dragonite 10 levels lower with stat exp. This means the ranking is still somewhat accurate, although the most rigorous way to do it would probably be to calculate the total exp you get for each trainer in the game after you catch it and figure out what level you would be. I hope people can understand that this would be extremely time consuming and the process for this video was extremely long already, hence why we did not go down this route. The way we modelled it is as if someone is using infinite rare candies, which I think still has value to a lot of the community. <br><br>Blue’s team is split into three and each one is weighted equally. I agree this is an oversight and does weight pokemon slightly to how well they perform in the champion fight. In future we will make sure to normalize fights like this down to one score.<br><br>Our ranking does not take into account valuable TMs being used up on the pokemon that maybe could have been used elsewhere. This may be something we can improve on in the future, but I&apos;m not 100% certain on how we&apos;d go about modelling this. If anyone with some math/stats knowledge has any suggestions for how this may be modelled please post them in the discord server!<br><br>A bug has also come to my attention where all mons on a trainer&apos;s team were set to level cap. Since this is even across all fights it should not effect the results majorly, however it has now been fixed for whenever we do this again.<br><br>Also just a note that the code, full results and a more detailed description of the process can be found linked in the description for those interested :)<br><br>- Craig/cRz Shadows (Programmer)

  240

• AZ

  @AzureAlliance31 · 2 years ago

  Jrose11 has entered the chat

  954

• UK

  @Ukkosade · 2 years ago (edited)

  What about a calculation of &quot;if every pokemon could be your starter pokemon&quot; ?

  371

• GS

  @gstvo. · 2 years ago

  i love the jjk references😭

  10

• AL

  @Alexand3ry · 2 years ago

  From the charts, it looks like all three Blue variants are scored fully... so this tells us which Pokemon would do best at beating the gyms, the Elite Four, and then Blue THREE TIMES IN A ROW. In other words, it&apos;s skewed to pokemon who can beat Pidgeot (x3) / Alakazam (x3) / Rhydon (x3) / Executor (x2) / Gyrados (x2) / Arcanine (x2) at level 61-65. It would be interesting to see how the rankings changed if each Blue encounter was weighted by 1/3.

  335

• JA

  @jackofspades4000 · 2 years ago

  MY BOY SANDSHREW I AM SO PROUD OF MY BOY

  113

• GR

  @grinchforest948 · 2 years ago

  <a href="https://www.youtube.com/watch?v=yGaJr7cQ3Nc&amp;t=208">3:28</a> Basically, the argument to put Ponyta much earlier, maybe near Bill(25 route).

  97

• DO

  @DoctorFalchion · 2 years ago (edited)

  I&apos;m a little confused as to why some Pokemon are listed in their pre-evolved forms (Ponyta, Caterpie, Pikachu) while some are listed as evolved (Weezing, Muk, Beedrill)

  86

• AD

  @aDiallo96 · 2 years ago

  Of course a Water and/or Psychic Type would DOMINATE Gen 1 Kanto. 🐐

  89

• HY

  @hyhyd6135 · 2 years ago

  &quot;We see a big jump for Dragonite and a stellar performance for Articuno&quot;<br>Articuno: <b>went up 50 places, yet the dragon is considered having the &apos;big jump&apos;</b>

  56

• FL

  @floodedmoat · 2 years ago

  Screw Pokémon master, this is a Pokémon PHD thesis

  197

• FA

  @fawfulfan · 2 years ago

  Fascinating. One flaw with this metric that immediately leapt to my head is, it doesn&apos;t account for the practicality of being able to get each tested moveset for a Pokémon in the early game. Some would require an unrealistic amount of grinding, and some would be flat-out impossible to obtain because they require TMs not available until the late game. Still, this seems as good a method for evaluating Pokémon usefulness as I&apos;ve ever seen someone come up with.

  11