Projects

MUST-CNN-RST

Preprocessing pipeline that turns Rhetorical Structure Theory treebank data into the per-position tagging input a multilayer CNN sequence model expects.

★ 0 Updated January 2017

Languages and discipline

Natural Language Processing Python

From undergrad, working with UVA's Bioinformatics Laboratory. The lab had built MUST-CNN, a multilayer shift-and-stitch convolutional network for per-position sequence tagging, developed for biological sequences. The open question was whether it would generalize to natural language.

To test that, I wrote a small pipeline with NLTK to convert the RST-WSJ treebank — the Rhetorical Structure Theory annotations over Wall Street Journal text — into the per-position tagging format the model expected: building a tag dictionary, splitting text into elementary discourse units, and aligning words to their EDU tags. Four scripts cover the pipeline end to end, run over the full RST-WSJ-main-1.0 corpus.

Old work, kept here as the earliest project I have a repo for.

← All projects