Testing performed by submitting commands to the software under test using programming interfaces of the application directly.