Code

Comparing for eventual rebase#2039

Code

Draft

zephirefaith wants to merge 93 commits intomainfacebookresearch/habitat-lab:mainfrom 0mdc/phase3facebookresearch/habitat-lab:0mdc/phase3Copy head branch name to clipboard

+3,802-449

Commits

Commits on Apr 29, 2024

• Add task config for multi-agent

  Ram81

  committed
  2944319

  Copy full SHA for 2944319

Commits on May 1, 2024

• changes to run barebone w/llm

  zephirefaith

  committed
  8c22953

  Copy full SHA for 8c22953

• basic plumbing into hitl

  zephirefaith

  committed
  e16ddbd

  Copy full SHA for e16ddbd

• fixing precommit

  zephirefaith

  committed
  7849ef6

  Copy full SHA for 7849ef6

Commits on May 2, 2024

• adding visual sensors

  zephirefaith

  committed
  e4631d5

  Copy full SHA for e4631d5

• config patching, remove unneeded super() calls

  zephirefaith

  committed
  0c0ed67

  Copy full SHA for 0c0ed67

• frankenstein hitl+llm config

  zephirefaith

  committed
  c8a9857

  Copy full SHA for c8a9857

Commits on May 6, 2024

• bandaids to get to working V0

  zephirefaith

  committed
  77880a3

  Copy full SHA for 77880a3

Commits on May 7, 2024

• Merge branch 'main' of github.com:facebookresearch/habitat-lab into zf/hitl-llm-interfacing

  zephirefaith

  committed
  eed48c1

  Copy full SHA for eed48c1

Commits on May 8, 2024

• making visual sensor changes configurable with explicit flags

  zephirefaith

  committed
  21ce0c4

  Copy full SHA for 21ce0c4

• delete sensors we do not need

  zephirefaith

  committed
  e74a92d

  Copy full SHA for e74a92d

Commits on May 12, 2024

• multi-threading + partial obs

  zephirefaith

  committed
  8e912e4

  Copy full SHA for 8e912e4

Commits on May 15, 2024

• speeding up the humanoid

  zephirefaith

  committed
  f62a4e9

  Copy full SHA for f62a4e9

• logging

  zephirefaith

  committed
  c71b55f

  Copy full SHA for c71b55f

• Merge branch 'main' of github.com:facebookresearch/habitat-lab into zf/hitl-llm-interfacing

  zephirefaith

  committed
  622f582

  Copy full SHA for 622f582

Commits on May 17, 2024

• moving habitat-llm stuff to dedicated file/module

  zephirefaith

  committed
  05ac703

  Copy full SHA for 05ac703

• +header,+-logging,-llm util

  zephirefaith

  committed
  998dd6d

  Copy full SHA for 998dd6d

• remove unused config

  zephirefaith

  committed
  ff0fb40

  Copy full SHA for ff0fb40

• optional logging, -llb-deps

  zephirefaith

  committed
  a87b1ba

  Copy full SHA for a87b1ba

Commits on May 23, 2024

• Disable new clone protection for git lfs (#1961)

  

  aclegg3

  authored and

  0mdc

  committed
  a0ab1c2

  Copy full SHA for a0ab1c2

• HITL - Make client loading state available to applications. (#1955)

  Show description for 48fdfdb
  0mdc

  committed
  48fdfdb

  Copy full SHA for 48fdfdb

• Add buttons and modal dialog boxes. (#1956)

  0mdc

  committed
  0963a59

  Copy full SHA for 0963a59

• Add configuration to enable new connections by default. (#1960)

  0mdc

  committed
  4e8650c

  Copy full SHA for 4e8650c

• Add textboxes. (#1957)

  0mdc

  committed
  8a653c2

  Copy full SHA for 8a653c2

• HITL - Add picture-in-picture viewports. (#1958)

  Show description for 783506e
  0mdc

  committed
  783506e

  Copy full SHA for 783506e

• HITL - Add object visbility handling and hide "self" in viewports. (#1959)

  Show description for e7e76ab
  0mdc

  committed
  e7e76ab

  Copy full SHA for e7e76ab

• Add autogenerated navmeshes to gitignore. (#1963)

  0mdc

  committed
  8a93681

  Copy full SHA for 8a93681

• HITL - Rearrange State Machine (#1964)

  Show description for 74c8df7
  0mdc

  committed
  74c8df7

  Copy full SHA for 74c8df7

• HITL - Rearrange session handling (#1965)

  Show description for bb2167d
  0mdc

  committed
  bb2167d

  Copy full SHA for bb2167d

• HITL - Data collection (#1967)

  Show description for a9a2912
  0mdc

  committed
  a9a2912

  Copy full SHA for a9a2912

• [BE/CI] - remove auto downloads (#1962)

  Show description for 91481fd
  

  aclegg3

  authored and

  0mdc

  committed
  91481fd

  Copy full SHA for 91481fd

• HITL - Add end episode form and error reporting (#1968)

  Show description for c3963a6
  0mdc

  committed
  c3963a6

  Copy full SHA for c3963a6

• Embodied Unoccluded Navmesh Snap util (#1949)

  Show description for 1031c8d
  

  aclegg3

  authored and

  0mdc

  committed
  1031c8d

  Copy full SHA for 1031c8d

• remove auto downloader from RearrangeDataset init (#1969)

  Show description for d675999
  

  aclegg3

  authored and

  0mdc

  committed
  d675999

  Copy full SHA for d675999

• add ignore_object_ids to snap_down API (#1971)

  

  aclegg3

  authored and

  0mdc

  committed
  8d0c9cf

  Copy full SHA for 8d0c9cf

• HITL - Decouple agents from users. (#1972)

  Show description for 0c05761
  0mdc

  committed
  0c05761

  Copy full SHA for 0c05761

• Change dataset config.

  0mdc

  committed
  1b3e7cf

  Copy full SHA for 1b3e7cf

Commits on May 28, 2024

• Config updates for remote HITL sessions.

  0mdc

  committed
  30712b0

  Copy full SHA for 30712b0

• Load llm extensions.

  0mdc

  committed
  0a88ef7

  Copy full SHA for 0a88ef7

• Update LLM config.

  0mdc

  committed
  1d8f031

  Copy full SHA for 1d8f031

• Remove dead code in LLM controller.

  0mdc

  committed
  d981be3

  Copy full SHA for d981be3

Commits on May 29, 2024

• Avoid errors when loading non-llm configs.

  0mdc

  committed
  4a8c77f

  Copy full SHA for 4a8c77f

• Remove superfluous dataset definition.

  0mdc

  committed
  a9e49f5

  Copy full SHA for a9e49f5

• Avoid resetting Habitat when resetting environment_interface.

  0mdc

  committed
  1965953

  Copy full SHA for 1965953

• Fix rearrange sensor initialization.

  0mdc

  committed
  dc65e92

  Copy full SHA for dc65e92

• Add rearrange_v2 config.

  0mdc

  committed
  60a08f9

  Copy full SHA for 60a08f9

• Set idle timer to 180s.

  0mdc

  committed
  fe5504c

  Copy full SHA for fe5504c

Commits on May 31, 2024

• event callbacks and action-space update

  zephirefaith

  committed
  cebd24b

  Copy full SHA for cebd24b

• added open/close callback too; test next

  zephirefaith

  committed
  72cb8f7

  Copy full SHA for 72cb8f7

Commits on Jun 1, 2024

• Speed up agent action thread.

  0mdc

  committed
  243df21

  Copy full SHA for 243df21

Commits on Jun 2, 2024

• Make Unity controls smoother.

  0mdc

  committed
  a9ff943

  Copy full SHA for a9ff943

• Code formatting and typing fixes.

  0mdc

  committed
  3ae3e3c

  Copy full SHA for 3ae3e3c

• Skip serialization of attributes missing mendatory values.

  0mdc

  committed
  5f07807

  Copy full SHA for 5f07807

• Fix other agent's sensor.

  0mdc

  committed
  9dcb6ce

  Copy full SHA for 9dcb6ce

• Add comment.

  0mdc

  committed
  4431ab2

  Copy full SHA for 4431ab2

Commits on Jun 3, 2024

• Query grasp manager to determine whether an object is picked by an agent.

  0mdc

  committed
  61750e4

  Copy full SHA for 61750e4

• Move HITL output to 'data/' so that it is ignored by git.

  0mdc

  committed
  5945cce

  Copy full SHA for 5945cce

• Fix place receptacle ID.

  0mdc

  committed
  0c585de

  Copy full SHA for 0c585de

Commits on Jun 4, 2024

• Use grasp manager to communicate grasp state to other systems.

  0mdc

  committed
  0d1d2fb

  Copy full SHA for 0d1d2fb

• Enable humanoid model in single-learn so that the human appears in the PiP viewport.

  0mdc

  committed
  3ac6df1

  Copy full SHA for 3ac6df1

• forward all the actions

  zephirefaith

  committed
  ef49e09

  Copy full SHA for ef49e09

• Merge branch '0mdc/phase3' of https://github.com/facebookresearch/habitat-lab into 0mdc/phase3

  zephirefaith

  committed
  2d2d1c5

  Copy full SHA for 2d2d1c5

• removing unnecessary measure

  zephirefaith

  committed
  38e9da2

  Copy full SHA for 38e9da2

• robustifying a bit

  zephirefaith

  committed
  e487e9f

  Copy full SHA for e487e9f

Commits on Jun 5, 2024

• receptacle naming

  zephirefaith

  committed
  95522f3

  Copy full SHA for 95522f3

• turn off magic desnapping

  zephirefaith

  committed
  7fa8f17

  Copy full SHA for 7fa8f17

Commits on Jun 6, 2024

• termination condition for single-learn case

  zephirefaith

  committed
  93ed72d

  Copy full SHA for 93ed72d

• adding termination event; bypassing planning when done

  zephirefaith

  committed
  2191f56

  Copy full SHA for 2191f56

• clean-up

  zephirefaith

  committed
  3031983

  Copy full SHA for 3031983

Commits on Jun 7, 2024

• Disable new connections by default.

  0mdc

  committed
  74829eb

  Copy full SHA for 74829eb

• Move agent head sensors to match GUI camera.

  0mdc

  committed
  7f3ccf1

  Copy full SHA for 7f3ccf1

• Disable RGB sensors.

  0mdc

  committed
  6e0cdfb

  Copy full SHA for 6e0cdfb

• adding task % progress

  zephirefaith

  committed
  41583e0

  Copy full SHA for 41583e0

• guard each agent's obs

  zephirefaith

  committed
  677d971

  Copy full SHA for 677d971

• Disable humanoid sensor auto-update.

  0mdc

  committed
  9b5ca88

  Copy full SHA for 9b5ca88

• Disable task success text. Add task success to data output.

  0mdc

  committed
  3e3324e

  Copy full SHA for 3e3324e

• Adjust episode termination signals for single-learn.

  0mdc

  committed
  b983eb3

  Copy full SHA for b983eb3

• Add skip episode app state.

  0mdc

  committed
  1757301

  Copy full SHA for 1757301

• Fix config typo.

  0mdc

  committed
  c455f7f

  Copy full SHA for c455f7f

• hot-fix for inaccessible receptacles

  zephirefaith

  committed
  5f756d5

  Copy full SHA for 5f756d5

• Merge branch '0mdc/phase3' of https://github.com/facebookresearch/habitat-lab into 0mdc/phase3

  zephirefaith

  committed
  859c0c5

  Copy full SHA for 859c0c5

• guard if no fur found for rec

  zephirefaith

  committed
  a6021cc

  Copy full SHA for a6021cc

• guards

  zephirefaith

  committed
  9bb5ec1

  Copy full SHA for 9bb5ec1

• typo

  

  zephirefaith

  authored and

  Ubuntu

  committed
  4a0d292

  Copy full SHA for 4a0d292

• first finish thread then reset env

  

  zephirefaith

  authored and

  Ubuntu

  committed
  08f9fb3

  Copy full SHA for 08f9fb3

• receptacle ID can be furniture ID

  

  zephirefaith

  authored and

  Ubuntu

  committed
  fe9d887

  Copy full SHA for fe9d887

Commits on Jun 10, 2024

• Formatting fix.

  0mdc

  committed
  de568e2

  Copy full SHA for de568e2

• Change data collection output folder.

  0mdc

  committed
  21aeea3

  Copy full SHA for 21aeea3

Commits on Jun 11, 2024

• handle error termination from user/agent

  

  zephirefaith

  authored and

  Ubuntu

  committed
  776f0c7

  Copy full SHA for 776f0c7

• sending error information

  

  zephirefaith

  authored and

  Ubuntu

  committed
  12e4f56

  Copy full SHA for 12e4f56

Commits on Jun 12, 2024

• Record episode status.

  0mdc

  committed
  f4fe7de

  Copy full SHA for f4fe7de

• guarding against exceptions and absence of handles

  

  zephirefaith

  authored and

  Ubuntu

  committed
  744dc38

  Copy full SHA for 744dc38

• Merge branch '0mdc/phase3' of https://github.com/facebookresearch/habitat-lab into 0mdc/phase3

  

  Ubuntu

  committed
  cc1584c

  Copy full SHA for cc1584c