command_line_tools.rst 1.8 KB

12345678910111213141516171819202122232425262728293031323334353637383940414243444546474849505152535455565758596061626364656667686970717273747576777879808182838485
  1. .. _Command-line Tools:
  2. Command-line Tools
  3. ==================
  4. Fairseq provides several command-line tools for training and evaluating models:
  5. - :ref:`fairseq-preprocess`: Data pre-processing: build vocabularies and binarize training data
  6. - :ref:`fairseq-train`: Train a new model on one or multiple GPUs
  7. - :ref:`fairseq-generate`: Translate pre-processed data with a trained model
  8. - :ref:`fairseq-interactive`: Translate raw text with a trained model
  9. - :ref:`fairseq-score`: BLEU scoring of generated translations against reference translations
  10. - :ref:`fairseq-eval-lm`: Language model evaluation
  11. .. _fairseq-preprocess:
  12. fairseq-preprocess
  13. ~~~~~~~~~~~~~~~~~~
  14. .. automodule:: fairseq_cli.preprocess
  15. .. argparse::
  16. :module: fairseq.options
  17. :func: get_preprocessing_parser
  18. :prog: fairseq-preprocess
  19. .. _fairseq-train:
  20. fairseq-train
  21. ~~~~~~~~~~~~~
  22. .. automodule:: fairseq_cli.train
  23. .. argparse::
  24. :module: fairseq.options
  25. :func: get_training_parser
  26. :prog: fairseq-train
  27. .. _fairseq-generate:
  28. fairseq-generate
  29. ~~~~~~~~~~~~~~~~
  30. .. automodule:: fairseq_cli.generate
  31. .. argparse::
  32. :module: fairseq.options
  33. :func: get_generation_parser
  34. :prog: fairseq-generate
  35. .. _fairseq-interactive:
  36. fairseq-interactive
  37. ~~~~~~~~~~~~~~~~~~~
  38. .. automodule:: fairseq_cli.interactive
  39. .. argparse::
  40. :module: fairseq.options
  41. :func: get_interactive_generation_parser
  42. :prog: fairseq-interactive
  43. .. _fairseq-score:
  44. fairseq-score
  45. ~~~~~~~~~~~~~
  46. .. automodule:: fairseq_cli.score
  47. .. argparse::
  48. :module: fairseq_cli.score
  49. :func: get_parser
  50. :prog: fairseq-score
  51. .. _fairseq-eval-lm:
  52. fairseq-eval-lm
  53. ~~~~~~~~~~~~~~~
  54. .. automodule:: fairseq_cli.eval_lm
  55. .. argparse::
  56. :module: fairseq.options
  57. :func: get_eval_lm_parser
  58. :prog: fairseq-eval-lm