• 0 Posts
  • 37 Comments
Joined 1 year ago
cake
Cake day: July 8th, 2023

help-circle
  • They could set up an account on one of the larger well established Canadian instances or even better start up their own.

    Both of these options have their pros and cons, and I think it is important to explain these well to the council if you want to have any hope of convincing them.

    A line of argument that has had some success in Europe is what has become known as “Digital Sovereignty”, basically a fancy term for saying government should control its own infrastructure. So you might want to sell it as an easy way to have a permanent archive of public communication and a method for it that is under their direct control, rather than as a way to find more engagement.

    As others have said self hosting has a maintenance and moderation overhead, but this can be lessened by running an instance together with other cities while still retaining most of the benefits of self hosting.

    Seeing from the linked cross-post that this is about Port Alberni, and considering that http://portalberni.ca/ returns an empty reply while https://portalberni.ca/ lets me know I have been geoblocked because I’m outside of Canada and the US, I’d say you have an uphill battle before you though. These people made a website (probably paid for it, too), and then killed much of its use by geoblocking most of the world.

    Good luck.


  • I don’t think capitalism is necessarily at fault, nor must the working/middle classes be struggling for fascism to emerge. If anything, quite the opposite. It is the better off countries that end up turning fascist. All fascist countries are/were first world countries, in various states of advanced development.

    That’s not right, at least not for the fascist regimes in Europe that emerged prior to WW2. The countries where it happened (specifically Germany/Italy/Spain) had all seen civil unrest or even civil war in the recent past, they were hit hard by the global financial crisis in the twenties and had high unemployment and widespread poverty. This was the very thing the fascists used to ingratiate themselves to the public at large, by creating jobs through massive public building and rearmament projects.

    By the way “first world countries” is post-WW2 terminology and didn’t originally have a connotation of superior economic status, but was referring strictly to ideological alignment. Whether a country belonged to the capitalist/communist/unaligned block in international politics during the cold war.




  • Right so WhatsApp and messenger are gatekeepers and they must allow interoperation with who anyone who wants to ie me running my own signal instance?

    There are several stipulations on interoperability in the new regulation (Ctrl+F “interop”). To my understanding it is stipulated that they have to make interoperability possible for certain third parties, but how to go about this is not exactly specified on a technical level - meaning the specific way to implement this is left to the gatekeeper. So your Signal server may or may not be able to depending on how exactly they go about this.

    They also need to interoperate with signal hence if a works with b and c works with a why wouldn’t b work with c?

    No they need to enable interoperability period. Says nothing about Signal (the software) per se. Meta has announced they plan on implementing it based on the Signal protocol (not Signal messenger software, not Signal server software).

    Cos if thats hoe it works or if im not allowed to interoperate with WhatsApp or messenger in the first place then this juat seems like its handing the monopoly away from the companies to the government and giving the people fuck all.

    To my knowledge the aim of the regulation is exactly that, to allow anybody interoperability with these “core platform services”. The status quo is that the regulations has been announced by the EU, it has gone into effect, and Meta has announced how they will implement interoperability to comply. Once the implementation is available and then found lacking in regard to the regulation it would be up to the affected third party to sue Meta over it.


  • In Germany, Mein Kampf is banned except for educational purposes, eg in history class.

    Strictly speaking this is incorrect, although the situation is somewhat complicated. There are laws that can be and were used to limit its redistribution (mainly the rule against anti-constitutional propaganda), but there are dissenting judgements saying original prints from before the end of WW2 cannot fall under this, since they are pre-constitutional. One particular reprint from 2018 has been classified as “liable to corrupt the young”, but to my knowledge this only means it cannot be publicly advertised.

    What is interesting though is how distribution and reprinting was prevented historically, which is copyright. As Hitlers legal heir the state of Bavaria held the copyright until it expired in 2015 and simply didn’t grant license to anything except versions with scholarly commentary. But technically since then anybody can print and distribute new copies of the book. If this violates any law will then be determined on a case-by-case basis after the fact.








  • If you rise anywhere above lever 5 or so, the difficulty ratchets up so much it makes the main quest nearly impossible to complete.

    Didn’t Oblivion already have the difficulty slider? You could just adjust that, no?

    I know level scaling is a big topic in the industry, but for me, the way it’s implemented nearly ruins what is otherwise a mostly great game.

    Two of the first RPGs I played were Gothic and Gothic II which released approximately alongside Morrowind and Oblivion, and they just had no dynamic level scaling at all, so I don’t really see the appeal either. A tiny Mole Rat being roughly the same challenge as a big bad Orc just breaks immersion. If you were to meet the latter in early game it would just curb stomp you, which provided an immersive way of gating content and a real sense of achievement when you came back later with better armour and weapons to finally defeat the enemy who gave you so many problems earlier. Basically the same experience you had with Death Claws in Fallout New Vegas when compared to Fallout 3 - they aren’t just a set piece, they are a real challenge.

    The games had their own problems, for example the fighting system sucked, and I’m told the English translation was so bad the games just flopped in the Anglosphere, putting them squarely in the Eurojank category of games. But creating a real sense of progression and an immersive world were certainly not amongst their weaknesses.




  • a neural network with a series of layers (W in this case would be a single layer)

    I understood this differently. W is a whole model, not a single layer of a model. W is a layer of the Transformer architecture, not of a model. So it is a single feed forward or attention model, which is a layer in the Transformer. As the paper says, a LoRA:

    injects trainable rank decomposition matrices into each layer of the Transformer architecture

    It basically learns shifting the output of each Transformer layer. But the original Transformer stays intact, which is the whole point, as it lets you quickly train a LoRA when you need this extra bias, and you can switch to another for a different task easily, without re-training your Transformer. So if the source of the bias you want to get rid off is already in these original models in the Transformer, you are just fighting fire with fire.

    Which is a good approach for specific situations, but not for general ones. In the context of OP you would need one LoRA for fighting it sexualising Asian women, then you would need another one for the next bias you find, and before you know it you have hundreds and your output quality has degraded irrecoverably.


  • Yeah but that’s my point, right?

    That

    1. you do not “replace data until your desired objective”.
    2. the original model stays intact (the W in the picture you embedded).

    Meaning that when you change or remove the LoRA (A and B), the same types of biases will just resurface from the original model (W). Hence “less biased” W being the preferable solution, where possible.

    Don’t get me wrong, LoRAs seem quite interesting, they just don’t seem like a good general approach to fighting model bias.


  • First, there is no thing as a “de-biased” training set, only sets with whatever target series of biases you define for them to reflect.

    Yes, I obviously meant “de-biased” by definition of whoever makes the set. Didn’t think it worth mentioning, as it seems self evident. But again, in concrete terms regarding the OP this just means not having your dataset skewed towards sexualised depictions of certain groups.

    1. either you replace data until your desired objective, which will reduce the model’s quality for any of the alternatives

    […]
    For reference, LoRAs are a sledgehammer approach to apply the first way.

    The paper introducing LoRA seems to disagree (emphasis mine):

    We propose Low-Rank Adaptation, or LoRA, which freezes the pre-trained model weights and injects trainable rank decomposition matrices into each layer of the Transformer architecture, greatly reducing the number of trainable parameters for downstream tasks.

    There is no data replaced, the model is not changed at all. In fact if I’m not misunderstanding it adds an additional neural network on top of the pre-trained one, i.e. it’s adding data instead of replacing any. Fighting bias with bias if you will.

    And I think this is relevant to a discussion of all models, as reproduction of training set biases is something common to all neural networks.


  • “Inclusive models” would need to be larger.

    [citation needed]

    To my understanding the problem is that the models reproduce biases in the training material, not model size. Alignment is currently a manual process after the initial unsupervised learning phase, often done by click-workers (Reinforcement Learning from Human Feedback, RLHF), and aimed at coaxing the model towards more “politically correct” outputs; But ultimately at that time the damage is already done since the bias is encoded in the model weights and will resurface in the outputs just randomly or if you “jailbreak” enough.

    In the context of the OP, if your training material has a high volume of sexualised depictions of Asian women the model will reproduce that in its outputs. Which is also the argument the article makes. So what you need for more inclusive models is essentially a de-biased training set designed with that specific purpose in mind.

    I’m glad to be corrected here, especially if you have any sources to look at.