← Back to tools

huniq

Remove duplicates from input without sorting

Text Processing linuxmacos Rust MIT

Description

huniq is a command line utility to remove duplicates from the given input. Unlike sort -u, huniq does not sort the input; it just removes duplicates while preserving the original order.

AI Summary

Remove duplicate lines from input while preserving original order

Capabilities

  • + Remove duplicate lines without sorting
  • + Preserve original line order
  • + Fast processing of large inputs

Use When

  • When removing duplicates while keeping order
  • When sort -u changes unwanted ordering

Avoid When

  • x When you also want sorted output

Related Tools

View AGENTS.md for huniq