Fragments

Thoughts as they occur to me.

My physical relationship to the internet

    Where I live there is very spotty cell service. If I'm not connected to WiFi at home or at the market, my connectivity to everyone is sort of fire and forget – the messages will go out, the messages will come it, but not immediately.

    The feeling is what I go over the hill and all of a sudden my phone blows up with notifications, then I'm off grid for the next few miles.

    Coverage is not better inside, or on the road or something – I get better service way out in the woods behind my house than I do on the town green.

    I'm used to this reality that its jarring when I take the train back to the city. At first, coverage is really bad on the train. I'll tether the laptop to the phone, and watch the packet loss slowly improve right up until I get to grand central.

    At home, everything is downloaded to the phone. PocketCasts streaming feature is basically pointless for me, I need to wait till it's downloaded before getting in the car.

    When I get to the city, the process is inverted. Why would I connect to the hotel's WiFi when it's so much easier and more reliable to tether through the phone?

    The internet on my home turf is more like being in an airplane – it works under certain situations, but it needs to be offline first.

    Why are LLMs so small?

    so much knowledge in such a small space

    LLMs are compressing information in a wildly different way than I understand. If we compare a couple open source LLMs to Wikipedia, they are all 20%-25% smaller than the compressed version of English wikipedia. And yet you can ask questions about the LLM, they can – in a sense – reason about things, and they know how to code.

    NAMESIZE
    gemma:7b5.2 GB
    llava:latest4.7 GB
    mistral:7b4.1 GB
    zephyr:latest4.1 GB

    Contrast that to the the size of English wikipedia – 22gb. That's without media or images.

    Shannon Entropy is a measure of information desitity, and whatever happens in training LLMs gets a lot closer to the limit than our current way of sharing information.

    5 year old hacking chatgpt

      We use the voice interface, this is what he came up with:

      Fifteen or twenty thousand years

        From What a major solar storm could do to our planet:

        Solar flares contain a colossal amount of energy—enough, in a large one, to meet our planet’s power needs for the next fifteen or twenty thousand years.

        That is a lot of years worth of energy.

        political implications

        The Washington Post asks What the world would look like without fossil fuels, which can be summed up as "out entire way of existence depends on a huge amount of energy almost all of which we get from oil". The rough idea they are explaining is that if we just stop building more wells and mines, things will gradually get more expensive and it will take a huge amount of time and resources to transition to other sources, but turning it off directly is unrealistic.

        Overall it tells a nice story, but what struck me was a paragraph at the end:

        “The biggest worry I have is: ‘What are the implications of the clean energy transition in some of the segments of the population that are badly affected?’” Birol said. “In a not very well-planned transition, there could be a bit of a backlash with political implications.”

        Basically, the transition will hurt a bunch of people, specifically the ones that are already under a smack-down. "Backlash with political implications".

        How about humanitarian implications? How about inequality, or general unfairness? Is the real problem here that it's politically inconvenient?

        Calling it "political" is such a euphemism.

        a good death

        On January 10th 2022 my wife Joy started to feel dizzy, sat down on a bench, and never woke up again.

        I think it's the best way to die, suddenly, quickly, without any pain or anxiety about what is going to happen or how a life was led.

        There was nothing leading up to it, and nothing to be done. No decisions to be made, nothing to second guess, no one to blame.

        She was with our youngest son at the time, and if it had happened 10 minutes sooner she would have been driving. Maybe the little guy would have been hurt, and it certainly would have been much more confusing to figure out what happened. She was a terrible driver so if she had drifted off at the wheel I would have blamed her.

        From her point of view, it was a short an anxiety free as it could have been. From our point of view, the fact that there was nothing that could have been done made it easy to accept – it was so shocking and in an "act of god" territory that all you could do was accept it. Every sort of what-if thought was shut down by the enormity of reality.

        It was very pure.

        locations in the magicians

          The Magicians is one of those series of books that I enjoy rereading. Not really sure why, but one thing that's surpising to me is how many of the real world places that seem to have inspired the book are in my orbit.

          In Brooklyn, there are a couple of scenes were they hang out in a dead zone near the Gowanus canal. I had a wild neighbor who used to own if not that exact spot, then something exactly like it.

          "Brakebills" exists somewhere upstate near West Point, and I've spend many hours in Bear Mountain.

          I've ended up in Arles a couple of times, and wandered through the back country around Murs when the gang went to look for ol' timy religions.

          Flying into the British Virgin Islands there was a passport problem with one of our group, and that outpost was definately reminicint of the end of Fillory.

          At the end of the last book, they get into a big fight in the woods of western Connecticut, which is where I live now. They take a train from Amenia back to the city, and I just got tacos in Amenia at this strange mexican grocery store that could very well have been a front for something. Tacos were great though.

          everything is equally evolved

          In astronomy, the term evolution refers to the production of elements, stars, galaxies, and the other configuration of inorganic matter.

          In biology, evolution refers to the adaptions of organisms to their environment through natural selection.

          In humans, or the psychosocial domain, evolution refers to a type of human growth and civilizational development.

          Each of these domains – inorganic, organic, psychosocial – operate on different principals. They are related, but each one has trancended the one previous. Inorganic evolution produces living species, giving rise to life; organic evolution produces intentional beings, giving rise to to consciousness.

          The third type of evolutionary trancendance isn't here yet, or at least isn't widely distributed.

          But if we think about the world and all of the things in it, its not right to say that some things are more evolved than others in the sense of better better or having progressed more; everything is as equally evolved as everything else since it's all been evolving together.

          timezones and dialects

            Timezones were created because of the trains. Before, everyplace has its own definition of noon, which was when the sun was at the highest. First proposed in 1883, it was eventually signed into US law in 1918 as the Standard Time Act.

            Where do languages come from? A language is a dialect with an army and navy.

            Where do dialects come from? I think from books, or more to the point publishers, who are trying to reach an audience and market. The more they publish in a certain dialect, the more that dialect is defined and reflected back to itself.

            The fluidity is then circumscribed a fixed by the commerce; in the first case transportation, and in the second place by book publishers and consumers. Without those forces, everything would be fluid and local.

            So Yiddish, the Hasidim not withstanding, has more of a chance of surviving because of all of its published literature.

            Should Robots Have Rites or Rights

            Here’s some food for thought: “Granting rights is not the only way to address the moral status of robots: Envisioning robots as rites bearers—not rights bearers—could work better.” A new paper, “Should Robots Have Rites or Rights,” suggests that “the Confucian alternative of assigning rites (or role obligations) is more appropriate than giving robots rights. The concept of rights is often adversarial and competitive, and the potential for conflict between humans and robots is concerning.”

            Turing Post FOD #10: Prompt Engineer vs AI Engineer, and Superhuman Human Fallacy

            Full PDF of the paper

            Excerpts:

            In Confucianism, individuals are made distinctively human by their ability to conceive of interests not purely in terms of personal self-interest—but instead in terms that also include a relational and communal self. Etymologically, the meaning of humanness ( , ren) is “two people.” The Confucian’s recognition of the communal self requires a distinctive perspective on rite or ritual. The Chinese term li ( , rite or ritual) symbolizes arranging vessels in a religious setting. But Confucian texts used li outside the scope of religious tradition. Examples abound, including friendship, gift giving, or forms of speech. The rites that concern Confucius are quotidian practices. Here is a modern example: “I see you on the street; I smile, walk toward you, put out my hand to shake yours. And behold—without any command, stratagem, force, special tricks or tools, without any effort on my part to make you do so, you spontaneously turn toward me, return my smile; raise your hand toward mine. We shake hands—not by my pulling your hand up and down or you pulling mine but by spontaneous and perfect cooperative action. Normally we do not notice the subtlety and amazing complexity of this coordination ritual act.”