You can swipe up or down to close activity while swiping image using viewpager
Use OnTouchListener of viewpager to detect touch event of user on screen and OnPageChangeListener to detect is user changing page to decide is activity should finish or not.