AtTiny85 reading from PIN

First, I’m kinda new to this AVR world, please don’t be too hard.

I’m running into a very simply problem. I’m trying to use the ATTiny85 inside the Arduino framework, but without the Arduino functions digitalRead or digitalWrite (too slow). I have no problem writing signal to pins (PORTB &= 0b00000001), But whatever I try, I’m not able to READ from the pin (PINB & 0b0000001).

However, this is not entirely true. whatever I try (PINB & 0b000001, PINB & 0b000010, PINB & 0b000100, I’m always value reading from the PIN 0 (physical pin 5). Does anyone have try to read the ATTiny pin without the Arduino function ?
I’m simply trying to do digital read here. (no analog)
Here a sample code which reproduce the problem.

  DDRB = 0b00001000; // set the LED pin as output.
  while (1) 
  {

    if ( PINB & 0b00000010 != 0) // read the PIN to check if the button is pressed.
    {
      PORTB = 0b00000000; //Turn Off the LED when the button is pressed
    }
    else
    {
      PORTB = 0b00001000;  //Turn on one LED by default
    }
  }  
}