lurkerlady [she/her]

  • 12 Posts
  • 72 Comments
Joined 2 years ago
cake
Cake day: March 28th, 2022

help-circle

  • Sure, there might be moderately-beneficial use-cases, maybe; but it doesn’t change the fact that there’s no such thing as an ethically-trained model, and there’s still no such thing as a model that wasn’t created based on rampant theft by capitalists, so I consider anything that comes of it fruit of the poison tree.

    I mean thats just the case with everything really. Theres a lot of very good use cases that are mostly to do with data manipulation, but the coolest ones are translating. I think we’re approaching a point where small models are providing very accurate translations and are even translating tone and intent properly, which is far superior to simple dictionary translation methods. I think its very possible that new phones could be outfitted with tensor cores and you could have a real-time universal translator in your hand, though it’ll likely only add ‘subtitles’ irl for you. AI voice-word recognition has also been very good and can be miniaturized. This is the use case I’m most excited for, personally, as a communist. Currently translating in a foreign country requires a lot of typing (if you dont have a perfect grasp of language) and it removes a very human element I feel to conversation. If everyone could locally run a subtitle-translation generation app it’d be amazing for all of humanity.

    Theres of course plenty of manufacturing use cases as well, but China is spearheading on that, though there is some work being done in the US as well in the few industries that remain.



  • This is accurate, though I am actually going to explain why. These big model companies (Google, ClosedAI, etc) parasitize the open-weights/open-source community that actually makes good Loras, fine tunes, and research papers. Consumer hardware simply hasn’t gotten good and cheap enough for very good fine tune training, and thats why this is all slowly petering out. In a couple of generations of consumer GPUs, which will be when we get consumer GPUs geared towards AI (re: super high VRAM counts of like 70gb+ for an affordable sub 700 usd cost), we might see another leap forward in this tech. Though I will say that this mostly pertains to LLMs, generative AI models like Stable Diffusion have a lot of tricks up their sleeves that can still be explored. Most of recent research and tweaking has been based around building a structure for the AI to build on, to sort of guide it rather than letting it take random stabs at things, in order to improve outputs. Some people have been doing things like hard coding color theory, framing a photograph, etc, and interpreting human language to trigger that hard code.

    We’ve had statistical models like these since the 50s. Consumer hardware has always been the big materialist bottleneck, this is all powered by small research teams and hobbyist nerds. You can throw a ton of money at it and have a giant research team, but the performance you squeeze out of adding 400b more parameters to your 13b model or having a gigantic locked-down datacenter is going to be diminishing.

    Also, synthetic data can be useful, people are hating on it in this thread but its a great way to reinforce good habits in the AI and interpret garbled code and speech that would otherwise confuse the AI. I sometimes feel like people just see something about ‘AI bad’ and upvote it and don’t try to understand it, where it is useful and where it is not, and so on.

















  • other fun things: rituals that give you free feats if you beat their ‘trial’, one of which is a ritual to create an elixir of immortality that poisons you, if you live through the poison, you become immortal, but if you break anathema and are past your normal lifespan, you die. anathema is 2-3 things you and the DM come up with that you cant do, like touching someone related to you, touching jade, eating meat, etc. if you do die in combat or something in a year youll descend from heaven and possess someone

    a handful of new deities that use new weapons and spells