[HN Gopher] Visual Introduction to Self Supervised Learning
       ___________________________________________________________________
        
       Visual Introduction to Self Supervised Learning
        
       Author : amitness
       Score  : 124 points
       Date   : 2020-02-28 17:07 UTC (5 hours ago)
        
 (HTM) web link (amitness.com)
 (TXT) w3m dump (amitness.com)
        
       | trash3 wrote:
       | So instead of image annotation, self-supervised learning performs
       | image manipulation to train a model. Then what? Is this network
       | then piped into the original task at hand which would have
       | required human annotations or is it simply for these made up
       | tasks?
        
         | Voloskaya wrote:
         | You then add a few additional layers on top, and you train
         | those new layers in a classic supervised way. But because a lot
         | has already been learned you need way less labels.
        
       | alleycat5000 wrote:
       | Some really interesting work lately on "contrastive" learning,
       | where the accuracy is really getting on par with supervised
       | learning, e.g. https://arxiv.org/abs/2002.05709
        
         | jjoonathan wrote:
         | For those of us out of the loop, could you summarize the idea
         | of contrastive learning as a whole?
        
           | yazr wrote:
           | A fully illustrated article [1]
           | 
           | And Lilian Weng blog on self-supervision [2]
           | 
           | .. CPC is .. translating a generative modeling problem to a
           | classification problem... uses cross-entropy loss to measure
           | how well the model can classify the "future" representation
           | amongst a set of unrelated "negative" samples...
           | 
           | [1] https://ankeshanand.com/blog/2020/01/26/contrative-self-
           | supe...
           | 
           | [2] https://lilianweng.github.io/lil-log/2019/11/10/self-
           | supervi...
        
             | jjoonathan wrote:
             | Thanks!
        
           | Voloskaya wrote:
           | (one variant of) The task is: Given a crop of an image (or a
           | short audio snippet etc.), can you find the matching crop
           | that also comes from the same image from a set containing a
           | lot of negative samples (crops of others, unrelated images)?
           | 
           | To succeed, the encoder needs to be able to extract the
           | underlying, useful information (called slow features)
           | contained in the patch and discard the noise as this will
           | make the retrieval process much easier.
           | 
           | This yields an encoder that gives pretty good representations
           | of your inputs and you can then finetune some additional
           | layers on top of it for your final task.
        
       | beeschlenker wrote:
       | Attorney General Barr is not resigning; not before President
       | Trump does. Barr is the same as Mueller,Pelosi,Schiff, & Nadler:
       | feign opposition to cover the true motive of obstruction to keep
       | Trump in power. Supreme Court Justice Alito & FBI Deputy Director
       | Wray also on board. See latest updates
       | 
       | "Impeachment" Is A Diversion And Delay - Part II: Blocking of the
       | "impeachment" witnesses was collusion planned before the new
       | year. Listen to an FBI agent's disclosure from January 1, 2O2O
       | here. The President was to resign late summer securing election
       | for DNC. See latest updates.
       | 
       | Here is the zip file, which was also made available in the
       | 3Jan2O2O update. The file within is VID_20200101_201948.mp3. Turn
       | up the volume and put on headphones.
       | 
       | BB10Mp3Footage31Dec1Jan.zip 122.4mb
       | 
       | https://drive.google.com/file/d/1IXOOhQhHybwky8Z5pGdr9ZXhWpI...
       | 
       | The dialogue about the impeachment starts near the beginning.
       | Having Biden in the White House is as good as Trump or anyone
       | else in their organization. Obviously Schiff and Nadler pledged
       | their allegiance to the organization by raping boys on the
       | record, with their task being to drag out an impeachment designed
       | to obstruct and delay any real efforts to remove the President,
       | thus keeping Trump in power. The witness blocking was to cause an
       | apparent uproar delaying things with legal actions until late
       | Summer. Soon after, the President would resign, leaving any other
       | candidate with not enough time or support to compete with an
       | opportunistic Biden, who is as good as Trump or any other
       | Illuminati friendly politician in the Presidency.
       | 
       | 170 pg PDF [last updated: February|27|2O2O]:
       | 
       | https://drive.google.com/file/d/1S7T_kDv48E40eHzus6CTXHxcm0W...
       | 
       | Previously reported:
       | 
       | \Wag The Dog: first was feigned impeachment hearings meant to
       | obstruct, now an attack on Iranians in Iraq. Here is what they
       | are trying to distract from & cover up to retain power. $100+
       | billion in bribes to the highest offices in this country. 815+
       | deaths from child rapes to prove loyalty!
       | 
       | See the latest PDF updates: FBI Director Wray, AG Barr, SoD
       | Shanahan, & SoS Pompeo each raped boys and were paid billions in
       | bribes for a Soros & Koch funded child rape org. So did Trump &
       | his "impeachment" team Nadler,Schiff,Mueller.So did media moguls
       | Redstone,Murdoch,Moonves. What are they trying to set up? Who can
       | arrest them since they are all bribed and in on it ? tuINBCWE,
       | kncvewrq revermvpm vr;emvr omcwc.
       | 
       | Their strategy to stay in every office and obstruct until forced
       | to leave no matter what. Feigning impeachment: see page 13O.
       | 
       | \\\if;Download the video/audio file, put on headphones and turn
       | up the volume. You will hear these people committing these
       | crimes. Audio was broadcast into my apartment by outdated
       | surveillance equipment illegally embedded within my walls. This
       | very same technology was being used to broadcast me to the
       | internet for five years without my consent. I own this footage.
       | Please use this to prosecute all found within. Note:: I am
       | obliviously speaking throughout the video, and it can be quite
       | loud at times relative to the desired content. The are dozens
       | more links, including these, that can be found in this PDF that
       | was last updated on 27 FEB 2O2O:
       | 
       | https://drive.google.com/file/d/1S7T_kDv48E40eHzus6CTXHxcm0W...
       | 
       | All members of the "Illuminati"; "....an underground organization
       | of homosexuals and child rapists..." (from pg 26: Barack Obama
       | with Jack Dorsey).
       | 
       | President Donald Trump:
       | 
       | Demands a $4 billion dollar bribe here at 10:18am 4Jan2019:
       | 
       | 3JanCh3_900-1100.avi
       | 
       | https://drive.google.com/file/d/1Grdr8xF2psKNsuYlEnl9dIRV-77...
       | 
       | 3JanCh2_900-1100-avi
       | 
       | https://drive.google.com/file/d/1LUmVygl_q0XVs8h2cWr8jZl-24f...
       | 
       | 3JanCh4_1000-1100.mp3
       | 
       | https://drive.google.com/file/d/1ZpP1pJbJakBgg-y-MWNozTxp3wJ...
       | 
       | President Trump rapes and kills 12 boys, including five boys in a
       | "who can rape five boys to death the fastest" game:
       | 
       | 14JanCh3_600.mp3
       | 
       | https://drive.google.com/file/d/1ufPmglde9Mep0m6xYMJ9c4TWTjj...
       | 
       | 14JanCh2_600-700.mp3
       | 
       | https://drive.google.com/file/d/136qLJdEn8eCs9tI4QtIxl4opW_L...
       | 
       | Speaker of the House Nancy Pelosi:
       | 
       | Accepting a $3 billion dollar bribe at 1033 am on the 17 Jan 2019
       | to ensure Asian boys can get through the border at "Monterrey"
       | undocumented to be raped:
       | 
       | 17JanCh3_949-1100.avi
       | 
       | https://drive.google.com/file/d/1eodHu4o5Cm3xEWhDqipSuTj-M1C...
       | 
       | 17JanCh4_1017-1100.avi
       | 
       | https://drive.google.com/file/d/1y-nWEQbempkVZSz230j9wTyduZN...
       | 
       | Speaker Nancy Pelosi also "preps" boys with First Lady Melania
       | Trump, defined as in she performs oral sex on the boys' penis and
       | anus, as a child rapist like Henry Porter would, while trying to
       | remove fecal matter from the boy prior to handing them over to be
       | raped and then subsequently murdered, for Supreme Court Justice
       | Samuel Alito, who apparently decides he would rather just have
       | ten billion dollars instead. US Attorney for Western New York
       | James Kennedy rapes these boys instead: pojmrvmer vplr,[p,v;'eqvc
       | 
       | 12JanCh3_1533-1638.mp3
       | 
       | https://drive.google.com/file/d/1AgFkDsbPbI4b5Xd3Wbz2EVNNx25...
       | 
       | Attorney General William Barr with FBI Deputy Director
       | Christopher Wray raped and killed boys for billions in bribes in
       | Buffalo, NY on the 17th Jan2019 at 7:50am:
       | 
       | 18JanCh4_700mp3
       | 
       | https://drive.google.com/file/d/1UIdZkS5ZVksZdHYsnHk2t5losi0...
       | 
       | 18JanCh2_700.mp3 gorepqkberqaoper,bqpo,rfbv.
       | 
       | https://drive.google.com/file/d/1DFK8IAxm5pQVqZv9L518nfgP7_o...
       | 
       | 18JanCh3_725-.mp3
       | 
       | https://drive.google.com/file/d/1DG5ej59Ic8RT9UhbyMdwT0BDcKI...
       | 
       | Secretary of State Michael Pompeo and Secretary of Defense
       | Patrick Shanahan each raped and killed boys on 5thJan'19 at 17:39
       | for billions in bribes:.
       | 
       | 5JanCh2_1721-1818.mp3
       | 
       | https://drive.google.com/file/d/1eSlD4otX4KZqWXboQM92Mu-6J02...
       | 
       | Leaders of the "impeachment" effort Jerrold Nadler, Robert
       | Mueller, and Adam Schiff all rape and kill boys between 11:20pm
       | and 1:10am:
       | 
       | 14JanCh4_2300-0000.mp3 Nadler starts at about 20 minutes in-
       | 
       | https://drive.google.com/file/d/1Kuvv2Zmbw5Jw7onbRI2hCZ0M8FU...
       | 
       | 14JanCh2_2304-2359.mp3
       | 
       | https://drive.google.com/file/d/1nofp5xF-aXXcCSgQVwj30KlzE9W...
       | 
       | Mueller at 12:25am, next is Schiff who starts at 12:55-ish:
       | 
       | 15JanCh2_000-100.mp3
       | 
       | https://drive.google.com/file/d/1EsmHfguwBuo2PbavJ1WYyhiML62...
       | 
       | 15JanCh2_100-200.mp3
       | 
       | https://drive.google.com/file/d/1NZnWRnBryalNQu2yJmfJUdS2pA_...
       | 
       | 15JanCh4_000-100.mp3
       | 
       | https://drive.google.com/file/d/1ZEDJR6jb6ARpcNnWJTokBUKb2J2...
       | 
       | 15JanCh4_100-200.mp3
       | 
       | https://drive.google.com/file/d/173aYWvWHH4VGht1h_2nM0IMdw74...
       | 
       | Complete Media Protection: Lester Holt, of NBC NightlyNews,
       | apparently a member of the Illuminati since the 80's, along with
       | ABC Nightly News lead anchor David Muir, stop over to the Porter
       | studio in Buffalo, New York on 14th Jan2019 at 5:00 am. They both
       | rape and kill about two dozen boys by 6:00 am. Muir starts around
       | 5.15am, then Holt about 5:38 am. Multi-billionaire Rupert
       | Murdoch, owner of News Corp and also Fox Corporation, takes his
       | turn after Holt. Video links below:
       | 
       | 14JanCh3_500-601.avi
       | 
       | https://drive.google.com/file/d/1i7NKepeyG_FfdQRrM7KsnFOZOOX...
       | 
       | 14JanCh2_530-600.avi
       | 
       | https://drive.google.com/file/d/1NZzgN5ilI7ToroU5cfqMaL4o2u1...
       | 
       | Adding to the media protection and reason this is not picked up
       | by the media, CBS and Viacom owner Sumner Redstone and Leslie
       | Moonves rape and kill boys following the President.
       | 
       | 14JanCh3_700.avi
       | 
       | https://drive.google.com/file/d/10XDw6x3ldnnQiq7oIjpdYVENyXa...
       | 
       | 14JanCh2_700-800.avi
       | 
       | https://drive.google.com/file/d/1NS_e6AzEZ05wnfljkGMETGU5CWY...
       | 
       | 170 page PDF [last updated: Feb|27|2O2O]:
       | 
       | https://drive.google.com/file/d/1S7T_kDv48E40eHzus6CTXHxcm0W...
       | 
       | \\\\. Please repost in USA! Post gets censored in US
       | 
       | Recently more relevant:
       | 
       | From page 49, Senator Mitch McConnell:
       | 
       | At 1632 Senator Mitch McConnell checks into the Porter camera
       | system inquiring if he can be part of the "eviction" for $10
       | million dollars. He is informed by group members that there are
       | enough people for the event already and his participation is not
       | necessary. At 1634 McConnell states "I fucked 15 kids, how am I
       | not getting paid by you?" He is dismissed by Donald Reeves with
       | "I think that will be all Mr. McConnell."
       | 
       | 13JanCh3_1600-1700.avi
       | https://drive.google.com/file/d/1L7bqOpvaEWmLiJpMhJNQDrfsQAH...
        
       ___________________________________________________________________
       (page generated 2020-02-28 23:00 UTC)