Skip to content

Commit

Permalink
implement ssd-1b inference
Browse files Browse the repository at this point in the history
  • Loading branch information
aniketmaurya committed Nov 30, 2023
1 parent 3d3f0e4 commit a1107ee
Showing 1 changed file with 6 additions and 3 deletions.
9 changes: 6 additions & 3 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -16,16 +16,19 @@ pip install .
python -m fastserve
```


## Usage/Examples

### Serve SSD-1B

```python
from fastserve import FastServe
from fastserve.models import FastServeSSD

serve = FastServe()
serve = FastServeSSD(device="cuda")
serve.run_server()
```

or, run `python -m fastserve.models --model ssd-1b` from terminal.


<!-- ## Demo
Expand Down

0 comments on commit a1107ee

Please sign in to comment.