Doc/FFmpeg Command Line Copy Section

前言

一、ffmpeg命令行

1、命令行参数介绍 Copy Chapter

| Print help/info: | Description |
|:-------------------|:-------------------------------|
| --help topic | show help |
| -version | show version |
| -formats | show available formats |
| -muxers | show available muxers |
| -demuxers | show available demuxers |
| -devices | show available devices |
| -codecs | show available codecs |
| -decoders | show available decoders |
| -encoders | show available encoders |
| -protocols | show available protocols |
| -filters | show available filters |
| -pix_fmts | show available pixel formats |
| -sample_fmts | show available sample formats |
| -hwaccels | show available HW acceleration |

| Global options: | Description |
|:-------------------|:-------------------------------|
| -v loglevel | set logging level |
| -y | overwrite output files |
| -n | never overwrite output files |
| -filter_threads | number of filter threads |
| -vol volume | change audio volume(256=normal)|

| main options: | Description |
|:-------------------|:-------------------------------|
| -f fmt | force format |
| -c codec | codec name |
| -codec codec | codec name |
| -t duration | duration seconds of audio/video|
| -to time_stop | record or transcode stop time |
| -ss time_off | set the start time offset |
| -frames number | set the number of frames |
| -discard | discard |
| -disposition | disposition |

| Video options: | Description |
|:-------------------|:-------------------------------|
| -vframes number | set the number of video frames |
| -r rate | set frame rate (Hz value) |
| -s size | set frame size |
| -aspect aspect | set aspect ratio (4:3, 16:9) |
| -vn | disable video |
| -vcodec codec | force video codec |
| -vf filter_graph | set video filters |
| -ab bitrate | audio bitrate (please use -b:a)|
| -b bitrate | video bitrate (please use -b:v)|

| Audio options: | Description |
|:-------------------|:-------------------------------|
| -aframes number | set the number of audio frames |
| -aq quality | set audio quality |
| -ar rate | set audio sampling rate (in Hz)|
| -ac channels | set number of audio channels |
| -an | disable audio |
| -acodec codec | force audio codec |
| -vol volume | change audio volume(256=normal)|
| -af filter_graph | set audio filters |

命令行整体格式：以ffmpeg开头，参数之间用空格隔开，每个参数key以"-"开头，后面跟着参数value，输出文件放在命令行最后。<br>

2、音频常见操作 Copy Chapter

2.1 音频转码 Copy Section

2.2 音频剪切 Copy Section

2.3 音频拼接 Copy Section

2.4 音频混音 Copy Section

2.5 空灵音效 Copy Section

2.6 惊悚音效 Copy Section

2.7 搞笑音效 Copy Section

2.8 静音检测 Copy Section

2.9 修改音量 Copy Section

2.10 抽取音频 Copy Section

3、视频常见操作 Copy Chapter

3.1 视频剪切 Copy Section

3.2 视频转码 Copy Section

3.3 视频截图 Copy Section

3.4 图片水印 Copy Section

public static String obtainOverlay(int offsetX, int offsetY, int location) {
    switch (location) {
        case 2:
            return "overlay='(main_w-overlay_w)-" + offsetX + ":" + offsetY + "'";
        case 3:
            return "overlay='" + offsetX + ":(main_h-overlay_h)-" + offsetY + "'";
        case 4:
            return "overlay='(main_w-overlay_w)-" + offsetX + ":(main_h-overlay_h)-" + offsetY + "'";
        case 1:
        default:
            return "overlay=" + offsetX + ":" + offsetY;
    }
}
public static String[] addWaterMarkImg(String inputPath, String imgPath, int location,
                                           int offsetXY, String outputPath) {
    String overlay = obtainOverlay(offsetXY, offsetXY, location);
    String waterMarkCmd = "ffmpeg -i %s -i %s -filter_complex %s -preset:v superfast %s";
    waterMarkCmd = String.format(waterMarkCmd, inputPath, imgPath, overlay, outputPath);
    return waterMarkCmd.split(" ");
}

3.5 GIF水印 Copy Section

3.6 去除水印 Copy Section

3.7 视频拼接 Copy Section

3.8 视频翻转 Copy Section

3.9 视频降噪 Copy Section

3.10 视频抽帧 Copy Section

3.11 播放速度 Copy Section

3.12 黑白视频 Copy Section

二、ffplay命令行

三、ffprobe命令行

如果要显示每帧数据信息，使用-show_frames可以显示pts、packet_size、duration、frame_type等信息：<br>
ffprobe -i input.mp4 -show_frames<br>

如果只要显示视频流，使用-select_streams v。其中v代表video，a代表audio，s代表subtitle。<br>
ffprobe -i input.mp4 -show_frames -select_streams v<br>

---

Doc/FFmpeg Compile Shell Copy Section

前言

一、准备工作

1、下载ffmpeg源码 Copy Chapter

2、下载ndk源码 Copy Chapter

二、编译ffmpeg源码

1、分析configure结构 Copy Chapter

| Help options: | Description |
|:------------------------|:----------------------------|
| --help | print this message |
| --list-decoders | show all available decoders |
| --list-encoders | show all available encoders |
| --list-hwaccels | show all available hardware |
| --list-demuxers | show all available demuxers |
| --list-muxers | show all available muxers |
| --list-parsers | show all available parsers |
| --list-protocols | show all available protocols|
| --list-filters | show all available filters |

| Licensing options: | Description |
|:------------------------|:----------------------------|
| --enable-gpl | allow use of GPL code |
| --enable-version3 | upgrade (L)GPL to version 3 |
| --enable-nonfree | allow use of nonfree code |

| Configuration options: | Description |
|:------------------------|:----------------------------|
| --prefix=PREFIX | install in PREFIX |
| --disable-static | do not build static libs |
| --enable-shared | build shared libraries [no] |
| --enable-small | optimize for size |
| --disable-all | disable components, libs |
| --disable-autodetect | disable detect external libs|

| Program options: | Description |
|:------------------------|:----------------------------|
| --disable-programs | don't build command line |
| --disable-ffmpeg | disable ffmpeg build |
| --disable-ffplay | disable ffplay build |
| --disable-ffprobe | disable ffprobe build |

| Component options: | Description |
|:------------------------|:----------------------------|
| --disable-avdevice | disable libavdevice build |
| --disable-avcodec | disable libavcodec build |
| --disable-avformat | disable libavformat build |
| --disable-swresample | disable libswresample build |
| --disable-swscale | disable libswscale build |
| --disable-postproc | disable libpostproc build |
| --disable-avfilter | disable libavfilter build |
| --disable-pthreads | disable pthreads |
| --disable-network | disable network support |

| Individual component: | Description |
|:------------------------|:----------------------------|
| --disable-everything | disable all components |
| --disable-encoder=NAME | disable encoder NAME |
| --enable-encoder=NAME | enable encoder NAME |
| --disable-encoders | disable all encoders |
| --disable-decoder=NAME | disable decoder NAME |
| --enable-decoder=NAME | enable decoder NAME |
| --disable-decoders | disable all decoders |
| --disable-muxer=NAME | disable muxer NAME |
| --enable-muxer=NAME | enable muxer NAME |
| --disable-muxers | disable all muxers |
| --disable-demuxer=NAME | disable demuxer NAME |
| --enable-demuxer=NAME | enable demuxer NAME |
| --disable-demuxers | disable all demuxers |
| --enable-parser=NAME | enable parser NAME |
| --disable-parser=NAME | disable parser NAME |
| --disable-parsers | disable all parsers |
| --enable-protocol=NAME | enable protocol NAME |
| --disable-protocol=NAME | disable protocol NAME |
| --disable-protocols | disable all protocols |
| --enable-filter=NAME | enable filter NAME |
| --disable-filter=NAME | disable filter NAME |
| --disable-filters | disable all filters |

| External library: | Description |
|:------------------------|:-----------------------------------------|
| --disable-avfoundation | disable Apple AVFoundation framework |
| --enable-jni | enable JNI support [no] |
| --enable-libaom | enable AV1 video codec via libaom [no] |
| --enable-libass | enable libass subtitles rendering [no] |
| --enable-libdav1d | enable AV1 decoding via libdav1d [no] |
| --enable-libfdk-aac | enable AAC de/encoding via libfdk-aac |
| --enable-libfontconfig | enable libfontconfig [no] |
| --enable-libfreetype | enable libfreetype, needed for drawtext |
| --enable-libfribidi | enable libfribidi, improves drawtext |
| --enable-libmp3lame | enable MP3 encoding via libmp3lame [no] |
| --enable-libopencv | enable video filtering via libopencv [no]|
| --enable-libopenh264 | enable H.264 encoding via OpenH264 [no] |
| --enable-libopus | enable Opus de/encoding via libopus [no] |
| --enable-librtmp | enable RTMP[E] support via librtmp [no] |
| --enable-libshine | enable fixed-point MP3 encoding |
| --enable-libsoxr | enable Include libsoxr resampling [no] |
| --enable-libspeex | enable Speex de/encoding via libspeex |
| --enable-libtensorflow | enable TensorFlow as a DNN module [no] |
| --enable-libvorbis | enable Vorbis en/decoding via libvorbis |
| --enable-libvpx | enable VP8 and VP9 de/encoding via libvpx|
| --enable-libx264 | enable H.264 encoding via x264 [no] |
| --enable-libx265 | enable HEVC encoding via x265 [no] |
| --enable-mediacodec | enable Android MediaCodec support [no] |
| --enable-opengl | enable OpenGL rendering [no] |
| --enable-openssl | enable openssl, needed for https support |

| Toolchain options: | Description |
|:------------------------|:----------------------------|
| --arch=ARCH | select architecture |
| --cpu=CPU | select the minimum CPU |
| --cross-prefix=PREFIX | use PREFIX for compile tool |
| --enable-cross-compile | assume a cross-compiler |
| --sysroot=PATH | root of cross-build tree |
| --target-os=OS | compiler targets OS |
| --toolchain=NAME | set tool according to name |
| --nm=NM | use nm tool NM [nm -g] |
| --ar=AR | use archive tool AR [ar] |
| --as=AS | use assembler AS |
| --strip=STRIP | use strip tool STRIP [strip]|
| --cc=CC | use C compiler CC [gcc] |
| --cxx=CXX | use C compiler CXX [g++] |
| --ld=LD | use linker LD |
| --host-cc=HOSTCC | use host C compiler HOSTCC |
| --host-cflags=HCFLAGS | use HCFLAGS when compiling |
| --host-ld=HOSTLD | use host linker HOSTLD |
| --host-ldflags=HLDFLAGS | use HLDFLAGS when linking |
| --host-extralibs=HLIBS | use libs HLIBS when linking |
| --host-os=OS | compiler host OS |
| --extra-cflags=ECFLAGS | add ECFLAGS to CFLAGS |
| --extra-cxxflags=ECFLAGS| add ECFLAGS to CXXFLAGS |
| --extra-ldflags=ELDFLAGS| add ELDFLAGS to LDFLAGS |

2、修改so后缀 Copy Chapter

SLIBNAME_WITH_MAJOR='$(SLIBNAME).$(LIBMAJOR)'
LIB_INSTALL_EXTRA_CMD='$$(RANLIB)"$(LIBDIR)/$(LIBNAME)"'
SLIB_INSTALL_NAME='$(SLIBNAME_WITH_VERSION)'
SLIB_INSTALL_LINKS='$(SLIBNAME_WITH_MAJOR)$(SLIBNAME)'

SLIBNAME_WITH_MAJOR='$(SLIBPREF)$(FULLNAME)-$(LIBMAJOR)$(SLIBSUF)'
LIB_INSTALL_EXTRA_CMD='$$(RANLIB)"$(LIBDIR)/$(LIBNAME)"'
SLIB_INSTALL_NAME='$(SLIBNAME_WITH_MAJOR)'
SLIB_INSTALL_LINKS='$(SLIBNAME)'

3、修改hevc_mvs.c Copy Chapter

libavcodec/hevc_mvs.c: In function 'derive_spatial_merge_candidates':
libavcodec/hevc_mvs.c:208:15: error: 'y0000000' undeclared (first use in this function)
((y ## v) >> s->ps.sps->log2_min_pu_size))
^
libavcodec/hevc_mvs.c:204:14: note: in definition of macro 'TAB_MVF'
tab_mvf[(y) * min_pu_width + x]
^
libavcodec/hevc_mvs.c:274:16: note: in expansion of macro 'TAB_MVF_PU'
(cand && !(TAB_MVF_PU(v).pred_flag == PF_INTRA))
^
libavcodec/hevc_mvs.c:368:23: note: in expansion of macro 'AVAILABLE'
is_available_b0 = AVAILABLE(cand_up_right, B0) &&
^
libavcodec/hevc_mvs.c:208:15: note: each undeclared identifier is reported only once for each function it appears in
((y ## v) >> s->ps.sps->log2_min_pu_size))
^
libavcodec/hevc_mvs.c:204:14: note: in definition of macro 'TAB_MVF'
tab_mvf[(y) * min_pu_width + x]
^
libavcodec/hevc_mvs.c:274:16: note: in expansion of macro 'TAB_MVF_PU'
(cand && !(TAB_MVF_PU(v).pred_flag == PF_INTRA))

#if CONFIG_LINUX_PERF
#ifndef _GNU_SOURCE
#define _GNU_SOURCE
#endif
#include <unistd.h>
#include <sys/ioctl.h>
#include <asm/unistd.h>
#include <linux/perf_event.h>
#endif

4、编译脚本 Copy Chapter

/ Detailed source-code truncated for AI context efficiency. /

5、编译问题分析 Copy Chapter

三、so库剪裁

1、encoders与decoders Copy Chapter

2、muxers与demuxers Copy Chapter

3、protocols Copy Chapter

4、parsers Copy Chapter

四、编译过程分析

1、预编译 Copy Chapter

2、编译 Copy Chapter

3、汇编 Copy Chapter

4、链接 Copy Chapter

5、FFmpeg的makefile分析 Copy Chapter

/ Detailed source-code truncated for AI context efficiency. /

---

Doc/JNI Develop Practice Copy Section

前言

NDK编译脚本 Copy Section

相关介绍文章如下： Copy Section

---

Doc/Multimedia Knowledge Copy Section

前言

1、音视频基本概念 Copy Section

2、视频封装格式 Copy Section

3、音频封装格式 Copy Section

4、音视频编码 Copy Section

5、音视频解码 Copy Section

6、音效(均衡器、混响、重低音) Copy Section

7、杜比音效AC3与AC4 Copy Section

8、杜比视觉Dolby-Vision与HDR Copy Section

9、Matroska封装格式 Copy Section

10、新一代视频AV1编码器 Copy Section

11、Android图像渲染框架 Copy Section

---

Doc/Multimedia Protocol Copy Section

多媒体协议与书籍 Copy Chapter

多媒体协议 Copy Section

多媒体书籍 Copy Section

---

Doc/Multimedia Work Copy Section

音视频工作方向概要 Copy Section

---

Doc/NDK Compile Shell Copy Section

前言

一、Android.mk语法

WORKING_DIR := $(call my-dir)
LOCAL_PATH := $(WORKING_DIR)
include $(CLEAR_VARS)
LOCAL_ARM_MODE  := arm
LOCAL_MODULE    := libffmpeg
LOCAL_SRC_FILES := $(LOCAL_PATH)/ffmpeg/$(TARGET_ARCH_ABI)/lib$(LOCAL_MODULE).so
LOCAL_EXPORT_C_INCLUDES := $(LOCAL_PATH)/ffmpeg/include
include $(PREBUILT_SHARED_LIBRARY)
include $(CLEAR_VARS)
LOCAL_ARM_MODE  := arm
#模块名称
LOCAL_MODULE    := hello
#源文件
LOCAL_SRC_FILES := hello.c
#头文件路径
LOCAL_C_INCLUDES := $(LOCAL_PATH)
#系统库依赖
LOCAL_LDLIBS    := -llog -lz -lm -landroid
#第三方动态库
LOCAL_SHARED_LIBRARIES := libffmpeg
#以动态库形式编译
include $(BUILD_SHARED_LIBRARY)

1、LOCAL_MODULE Copy Chapter

2、LOCAL_SRC_FILES Copy Chapter

3、LOCAL_C_INCLUDES Copy Chapter

4、LOCAL_CPP_EXTENSION Copy Chapter

5、LOCAL_CPP_FEATURES Copy Chapter

6、LOCAL_CFLAGS Copy Chapter

7、LOCAL_STATIC_LIBRARIES Copy Chapter

8、LOCAL_SHARED_LIBRARIES Copy Chapter

9、LOCAL_LDLIBS Copy Chapter

10、 LOCAL_ARM_MODE Copy Chapter

11、LOCAL_ARM_NEON Copy Chapter

12、TARGET_ARCH Copy Chapter

13、TARGET_PLATFORM Copy Chapter

14、打印信息 Copy Chapter

15、if条件判断 Copy Chapter

ifeq($(TARGET_ABI), arm64-v8a)
$(debug 'This is arm64-v8a')
endif

二、Application.mk语法

APP_STL      := c++_static
APP_DEBUG    := false
APP_OPTIM    := release
APP_CPPFLAGS := -frtti
APP_PLATFORM := android-16
APP_ABI      := armeabi-v7a arm64-v8a

1、APP_ABI Copy Chapter

2、APP_BUILD_SCRIPT Copy Chapter

3、APP_OPTIM Copy Chapter

4、APP_PLATFORM Copy Chapter

5、APP_STL Copy Chapter

三、CMakeLists.txt语法

以编译hello模块以及依赖ffmpeg模块为例：

cmake_minimum_required(VERSION 3.4.1)
#添加动态库，包含源文件路径
add_library( hello
             SHARED
             src/main/jni/hello.c)
#添加第三方动态库
add_library( ffmpeg
             SHARED
             IMPORTED )
#指定第三方库路径
set_target_properties( ffmpeg
                       PROPERTIES IMPORTED_LOCATION
                       ../../../../libs/${CMAKE_ANDROID_ARCH_ABI}/libffmpeg.so )
set(CMAKE_CXX_FLAGS "${CMAKE_CXX_FLAGS} -std=gnu++11")
#指定头文件路径
include_directories(src/main/cpp)
if(${CMAKE_ANDROID_ARCH_ABI} MATCHES "armeabi-v7a")
    include_directories(src/main/cpp/include/armeabi-v7a)
    message("This is armeabi-v7a")
elseif(${CMAKE_ANDROID_ARCH_ABI} MATCHES "arm64-v8a")
    include_directories(src/main/cpp/include/arm64-v8a)
    message("This is arm64-v8a")
endif()
#查找系统库
find_library( # Sets the name of the path variable.
              log-lib
              log )
#链接目标库
target_link_libraries( hello
                       ffmpeg
                       ${log-lib} )

1、add_library Copy Chapter

2、set_target_properties Copy Chapter

3、include_directories Copy Chapter

4、find_library Copy Chapter

5、target_link_libraries Copy Chapter

6、if条件判断 Copy Chapter

7、打印日志 Copy Chapter

8、命令行参数 Copy Chapter

* -DANRDOID_ABI :android的ABI架构平台

* -DANDROID_NDK :ndk路径

* -DANDROID_ARM_MODE :arm模式/thumb模式

* -DANDROID_ARM_NEON :是否开启arm neon加速，针对armeabi-v7a平台

* -DANDROID_TOOLCHAIN :编译工具链

* -DANDROID_NATIVE_API_LEVEL :与ANDROID_PLATFORM相同，对应minSdkVersion

* -DCMAKE_BUILD_TYPE :编译类型，debug或release

* -DCMAKE_MAKE_PROGRAM :编译程序

* -DCMAKE_TOOLCHAIN_FILE :编译文件

9、命令行编译 Copy Chapter

cmake \
    -DANDROID_ABI=armeabi-v7a \
    -DANDROID_NDK=${HOME}/Android/Sdk/ndk-bundle \
    -DCMAKE_BUILD_TYPE=Debug \
    -DCMAKE_MAKE_PROGRAM=${HOME}/Android/Sdk/cmake/3.6.3155560/bin/ninja \
    -DCMAKE_TOOLCHAIN_FILE=${HOME}/Android/Sdk/ndk-bundle/build/cmake/android.toolchain.cmake \
    -DANDROID_NATIVE_API_LEVEL=23 \
    -DANDROID_TOOLCHAIN=clang

四、ndk编译配置

1、Android.mk方式配置 Copy Chapter

defaultConfig {
    ......
    ndk {
        moduleName "hello"
        abiFilters "armeabi-v7a", "arm64-v8a"
    }
}

sourceSets {
    main {
        jniLibs.srcDir 'src/main/libs' // Enable to use libs
        jni.srcDirs 'src/main/jni' // Enable the automatic ndk-build
    }
}

externalNativeBuild {
    ndkBuild {
        "src/main/jni/Android.mk"
    }
}

2、CMake方式配置 Copy Chapter

externalNativeBuild {
    cmake {
        path "CMakeLists.txt"
    }
}

externalNativeBuild {
    cmake {
        cppFlags ""
    }
}

五、ndk编译过程

1、ndk-build编译 Copy Chapter

2、cmake在Gradle中编译 Copy Chapter

---

Doc/Player Framework Copy Section

前言

1、ijkplayer的API详细介绍 Copy Chapter

2、ijkplayer的时序图与状态图分析 Copy Chapter

3、ijkplayer自定义协议播放加密视频 Copy Chapter

4、ijkplayer音频解码播放架构分析 Copy Chapter

5、ijkplayer视频解码播放架构分析 Copy Chapter

6、ijkplayer播放器架构从原型到升级 Copy Chapter

7、ijkplayer音视频同步策略分析 Copy Chapter

---

README Copy Section

FFmpegAndroid

FFmpeg官方文档 FFmpeg官方文档')" title="Copy section prompt for LLMs"> Copy Section

FFmpeg编译流程 FFmpeg编译流程')" title="Copy section prompt for LLMs"> Copy Section

FFmpeg常用命令行 FFmpeg常用命令行')" title="Copy section prompt for LLMs"> Copy Section

FFmpeg源码分析 FFmpeg源码分析')" title="Copy section prompt for LLMs"> Copy Section

JNI与NDK开发 JNI与NDK开发')" title="Copy section prompt for LLMs"> Copy Section

音视频知识汇总 音视频知识汇总')" title="Copy section prompt for LLMs"> Copy Section

ijkplayer播放器架构 ijkplayer播放器架构')" title="Copy section prompt for LLMs"> Copy Section

----------------------------------------------------------------------------------------------------

常见的流媒体传输协议包括：RTP、RTMP、RTCP、RTSP，流媒体应用协议有HLS、DASH，</br>
WebRTC设计传输协议有SDP、ICE、NAT、STUN等，常用视频编码协议有H264、HEVC、VVC，</br>
常用的视频封装格式有mp4，关于C/C++语言标准有C11、C20++等，书籍包括音视频编解码等。</br>
详细列表可以查阅：多媒体协议与书籍

音视频工作方向包括:直播、短视频、流媒体传输、视频播放器、音乐播放器、音视频算法、</br>
流媒体后端、音视频编辑、图像处理(个人概括，具体方向不限于此)。</br>
详情可查阅：音视频工作方向

音视频基础知识: Copy Section

音视频进阶成长: Copy Section

音视频开源库: Copy Section

Joining the group to learn FFmpeg: Copy Section

---