ministf

Frontend

1. display current device screen in frame
2. whenever mouseclick is registered, it is sent to the backend

Backend

1. minicap captures the current android screen at ~10 fps
2. backend sends the images to frontend on each screen capture
3. when frontend registers mouseclick, the coordinates are sent here and using minitouch, propagated to device
4. either before, or after the event, the view hierarchy is captured

• View hierarchy
  • adb forward tcp:1699 tcp:1699
  • adb shell dumpsys activity start-view-server
    • d
• Minicap
  • adb forward tcp:1717 localabstract:minicap
  • ./run.sh -P 1440x2560@360x640/0
• Minitouch
  • adb forward tcp:1111 localabstract:minitouch
  • adb shell /data/local/tmp/minitouch
• frontend
  • npm start
• backend
  • npm start

• Add mouse drag events
• Cap framerate for minicap to 10fps
• Fix view hierarchy
  • adb shell dumpsys activity start-view-server
  • adb forward tcp:<port> tcp:1699
  • nc localhost <port>
• Keyboard events
• Easier startup

• minitouch
• minicap
• openstf
• crowdstf
• crowdstf notes
• crowdstf zipt interface
• adb
• pyadb