Add search completion example

(cherry picked from commit 15aeb5f)

Author: ospillinger

examples/README.md

@@ -14,6 +14,8 @@
 
 - [Iris classification](pytorch/iris-classifier): deploy a model to classify iris flowers.
 
+- [Search completion](pytorch/search-completer): deploy a model to complete search terms.
+
 - [Text generation with DistilGPT2](pytorch/text-generator): deploy Hugging Face's DistilGPT2 model to generate text.
 
 - [Answer generation with DialoGPT](pytorch/answer-generator): deploy Microsoft's DialoGPT model to answer questions.

examples/pytorch/search-completer/cortex.yaml

@@ -0,0 +1,11 @@
+- kind: deployment
+  name: search
+
+- kind: api
+  name: completer
+  predictor:
+    path: predictor.py
+  compute:
+    cpu: 1
+    gpu: 1
+    mem: 4G

examples/pytorch/search-completer/predictor.py

@@ -0,0 +1,12 @@
+import torch
+import regex
+import tqdm
+
+roberta = torch.hub.load("pytorch/fairseq", "roberta.large")
+roberta.eval()
+roberta.cuda()
+
+
+def predict(sample, metadata):
+    predictions = roberta.fill_mask(sample["text"] + " <mask>", topk=5)
+    return [prediction[0] for prediction in predictions]

examples/pytorch/search-completer/requirements.txt

@@ -0,0 +1,3 @@
+torch
+regex
+tqdm

examples/pytorch/search-completer/sample.json

@@ -0,0 +1,3 @@
+{
+  "text": "machine learning is"
+}