shnizmuffin

CTRL+Z

  • 55 Posts
  • 870 Comments
Joined 2 years ago
cake
Cake day: July 6th, 2023

help-circle










  • If I were to ask my Magic 8 Ball “Is the word ‘difinitely’ misspelled?” 100 times, it’s going to reply in the affirmative over 16% of the time. Literally double. This would also be “the very first experiment in this use case, done by a single person on a model that wasn’t specifically designed for this.”

    It’s not impressive.

    The issue with hallucinations…

    This is the real problem: working under the false assumption that there are two kinds of output. It’s all the same output. An LLM cannot hallucinate in the same way that it cannot think or reason. It’s fancy autofill. Predictive text.

    You can use it to brainstorm creative solutions, but you need to treat its output for what it is: complicated dice rolls from the tables in the back of the Dungeon Masters Guide. A fun distraction. Implausible fantasy 9 times out of 10.



  • In 100 runs only 8 correctly identify the targeted vulnerability, the rest are false positives or claim that there are no vulnerabilities in the given code. … [The] signal to noise ratio is very low, and one has to sift through a lot of wrong reports to get a realistic one.

    It was right 8% of the time when presented the least amount of input to find a known bug. Then, when they opened it up to more of the codebase, its performance decreased.

    I’m not going to use something that’s wrong over 92% of the time. That’s insane. That’s like saying my Magic 8 Ball “could be used as a useful tool for helping to detect vulnerabilities.” The fucking rubber ducky on my desk has a more reliable clearance rate.









  • That’s what Rocky was about,” [Stallone] said. “Having the opportunity. Not to win. Not to set records. Not someday to be made into a statue. But just the opportunity to run the race and see if you can finish.” The statue, he added, “is not about me. It’s about you. Because inside of every one of you, there’s a real Rocky.”

    Long-time Philadelphia Inquirer writer Clark DeLeon, posted the following observation after attending the unveiling ceremony:

    “…Among the thousands who crammed into the green leafy area on the north side of the front steps of the Art Museum Friday evening, dodging rush hour traffic to see and hear Sylvester Stallone speak at the unveiling of the Rocky statue, I must have heard five foreign languages spoken by those who eagerly sought to get a glimpse.

    “I heard Chinese, I heard German, I heard what could have been Serb or Croatian, I heard Philippino….

    “I’m not saying that Philadelphia isn’t a cosmopolitan city, but in my lifetime of walking its streets, I’ve never heard so many different foreign languages in such a short time."

    Source.

    Edit: punctuation.