• 0 Posts
  • 25 Comments
Joined 2 months ago
cake
Cake day: July 10th, 2024

help-circle




  • If we’re speaking of transformer models like ChatGPT, BERT or whatever: They don’t have memory at all.

    The closest thing that resembles memory is the accepted length of the input sequence combined with the attention mechanism. (If left unmodified though, this will lead to a quadratic increase in computation time the longer that sequence becomes.) And since the attention weights are a learned property, it is in practise probable that earlier tokens of the input sequence get basically ignored the further they lie “in the past”, as they usually do not contribute much to the current context.

    “In the past”: Transformers technically “see” the whole input sequence at once. But they are equipped with positional encoding which incorporates spatial and/or temporal ordering into the input sequence (e.g., position of words in a sentence). That way they can model sequential relationships as those found in natural language (sentences), videos, movement trajectories and other kinds of contextually coherent sequences.



  • NEVER consume media legally

    Given our current economic system and supposing that you can’t change it for now, how would you support a living for media creators (movies, shows, games, art, music, whatever)?

    Genuine question. I find myself on the fence about this. Currently, I consume media legally due to several reasons:

    • Supporting the creators and thereby incentivising them to produce more of stuff which I enjoyed.
    • I can afford it.
    • I would like to keep it legal.

    Stuff like this (although not affected since I don’t live in a country with that shitty laws), but also the decline of quality products as a result of companies trying to maximize their profit margins by producing a lot of cheap trash, as well as the criminalization of consumers and the fact that the profits are not shared equally among the creators but rather a few get the most while the rest gets some pennies (an issue present in virtually every business), make me really favour the idea of getting a pirate hat.

    However:
    If everyone would do this, this would lead to the death of the media industry, since no one would be able to pay for the productions and everyone involved anymore.
    How would get those productions then?

    Really, I think the only way to change this is to impose much better laws on the one hand and switch to a different, better, economic system on the other hand. But I don’t see these things coming soon. Which leaves me with staying legal.

    I would like to read your thoughts on that. (And those of everyone else who wants to chime in.)









  • A super important life lesson is to always put yourself and your mental health before the company.

    This should be the norm. Companies usually don’t care enough about you. They try to nurture loyalty in order to keep wages down while a few up in the hierarchy reap most of the rewards of your hard work.

    If you were lying in the death bed, you probably wouldn’t look back and think: “oh gee, I wish I would’ve worked more!”

    So always put yourself first over some company.





  • “Great wall of fuck”, that’s creative haha, I like it. xD
    I’m sorry if this offended you. It really wasn’t my intention to let you feel that way. I just wanted to spread some awareness about this as it’s one of our civilisation’s great dietary problems. What you do with that piece of information is of course up to you.

    and the fact that you assume some stranger on the internet has a diet so bad

    I feel like you’ve not read the part where I said the following:

    So, if you’re interested in your health, try to get an overview on how much salt you consume on average.

    Which should show that I didn’t assume that you specifically have a bad diet. But maybe I haven’t expressed myself carefully enough.

    but please, find something else to do

    Unfortunately, I have to disappoint you in that as writing great walls of fuck on Lemmy, is sometimes a preferred time killer of mine. Also, my experience shows that there are also other readers on Lemmy who can be interested in such great walls of fuck.


  • Salt is contained in a lot of products. Got salted butter? Smear it on bread. Guess which ingredient is used in bread. Correct: salt. Maybe you put some cold cuts on it. They’ve got a lot of salt. What about cheese? Salt again. Now you move on to your coffee. You put dairy milk in it: salt. Lunch? Probably a lot of salt. Dinner? Needless to say. If you snack some chips, well, obviously it’s a shitload of salt.

    Salt is everywhere. Especially in today’s food industry. Having salt is not necessarily bad for one’s health – in fact, we do need salt for our body to function – but as usual it’s the amount that matters.

    And according to several dietary authorities worldwide, most people eat too much salt.

    WHO:

    The global mean intake of adults is 4310 mg/day sodium (equivalent to 10.78 g/day salt) (1). This is more than double the World Health Organization recommendation for adults of less than 2000 mg/day sodium (equivalent to < 5 g/day salt).
    https://www.who.int/news-room/fact-sheets/detail/salt-reduction

    FDA (USA):

    Americans consume on average 3,400 milligrams (mg) of sodium per day—nearly 50%more than the 2,300 mg limit recommended by federal guidelines for people 14 years and older. Recommended limits for children 13 and younger are even lower.
    https://www.fda.gov/food/food-labeling-nutrition/sodium-reduction

    Overview in EU:

    International health-related organisations have issued recommendations to limit salt intake to no more than 5 or 6 g per day (see Table 3A). In the EU, most national recommendations that quantify salt intake recommend the same. […]
    In the majority of European countries, the range of intake is 7 to 12 grams of salt per day
    https://knowledge4policy.ec.europa.eu/health-promotion-knowledge-gateway/dietary-saltsodium_en

    Salt is one of those substances which have large effects even in low doses. Therefore, being above the recommended intake on average increases risks of suffering mainly from:

    cardiovascular diseases, stomach cancer and chronic kidney disease
    https://knowledge4policy.ec.europa.eu/health-promotion-knowledge-gateway/dietary-saltsodium_en

    So, if you’re interested in your health, try to get an overview on how much salt you consume on average. And if it’s above the recommended intake (which is usually the case), consider whether you really really can not live without salted butter or try to cut down on salt with other meals. And probably, taking the shaker off the table won’t be enough.